2022-09-17T10:16:53.825 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-17T10:16:53.828 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi --owner scheduled_teuthology@teuthology --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}} --archive /home/teuthworker/archive/teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi/7030120 -- /home/teuthworker/archive/teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi/7030120/orig.config.yaml 2022-09-17T10:16:53.906 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-09-17T10:16:54.001 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi/7030120 branch: pacific description: fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}} email: ceph-qa@ceph.io first_in_suite: false job_id: '7030120' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: pacific ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 9f1013ad23aaca59f081f4d35bc048be3d0598b7 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 9f1013ad23aaca59f081f4d35bc048be3d0598b7 kclient: mntopts: - nowsync selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: pacific sha1: 9f1013ad23aaca59f081f4d35bc048be3d0598b7 owner: scheduled_teuthology@teuthology priority: 500 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: 9f1013ad23aaca59f081f4d35bc048be3d0598b7 sleep_before_teardown: 0 suite: fs suite_branch: pacific suite_path: /home/teuthworker/src/git.ceph.com_ceph_9f1013ad23aaca59f081f4d35bc048be3d0598b7/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: 9f1013ad23aaca59f081f4d35bc048be3d0598b7 targets: smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxz0JUOMtlMwzFlHzdrV7GrJ1WN+yORXfLJJUwmYxTbRJNwKSFx79gtmHwjGsIngx7DTyEINMCV0jJ+VrsZtMuepuvlAFIZ1fwgs72PZeOl9j8QJpJx6hoORYYRwWSR1VHqfXoTIZQeJ4xn1huS72UVkMn9gD3Uxkbuz+HmQTOdI4VcZLeLLUIlcn/xhYjO6hyMYHpSbWxilW6L3VuEIEBMso/Dhai26KB1DT99L6+5cO0q97IjCi2YG0MynDfw+/g1lePdNX6QKgeaVFEeOk/0Xt1wlJkce34wfoicqp682/5tNFKrp2ogh7CCR1ATHVn9pm0dFKjpCME3e1jwNAFOMh3OYAI7Acc+U96zTH8FXdkWVM+XRrJYOw2M7W+fxkWK2exYEPhvVJ7VGdUZYjU6sp675BaMfs5pwxszSalVjVsOF61uwk1KRfik/tR41N2qmqmGMsUllXmzNTDX7KOjO3rqweRwQ8MqtS+Qi5vL6o1naIIsePCSCB7/4vGSyk= smithi093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC++6dg173hSv4S6r4QMmDbF+nmRacVQoAHxIgOUv9R8QsVHKG3DmhgPJB5B3EtJ93j76wnCZOKOOd//KMNJ51tAft0Gu0vZOAyvIZkRQyYlUUIZ1KIPnxYZ4N+ybAsJajMdmnnfNMBeoHQ568b4dGoO6xl2hZEhmv+z09l2P5iZpF4a0NsBt1+BCa63wlwcZb8eJFswPxDo0hk27d9VLmg0w2LjAwlib9zHkOkwMrEx/ESsOaZdH+tQ4RgUXYybkzDkjnQX29c3gzrL+40Ml/MHot7Od/wvTUWjPgs9V0W62TxJrEZ8QyYr6J6aaX/0SO0D3XzYz84rmICUTP2nGT2sKQv0IRa1OvRtBjC4GX/QMY15qojy7QXp1VTayMd8OxGSJjGhAMBsoqU1FPFSdXeR+s/xDytEpFlENnfNXJB0LJ4CpwNtnq5xHF+5vNE3vw3tXxq1yONBgrn3KsmvWqoe/MXDuAOyVeOe4RqE23/xKDg+U8Jud/6soIKtbHNkAk= smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuGVEdNCo+VXOeCsmzBgKIG1HsqkdQx1SMsfclLCoyFBNGQr66KL7dLiHfW00dRNVAFVm9qoDwqySyAUsOZr6szhFMOuh/GtcfeUXVa05OeAPukUVbzTjdk0cDqlZ7AlLJHQ76NfWx4HmNmVorf57tQZkVvmchYCf91fHacjZbHhkk9BjE2T2b5VHzzQZ4uXG5N9O8WmmHfcC2fbCyr+b3FBJF4nKC9UTndghUgzS+iuGtUytwdb1Q/BG0Mmr7WFQmWEIA0XNJjF/ZwN/BsXPulwMqMyO9O822BbHCy/IDLKWEpiHGNcFuOqFN1OQU62RusQcBR045d+fh84WYzDQSL9eHIjBiIjDPg8AyicQBBqQW+uFMDL/+QzHA7vHdpA7eN2/VzKbHDrmMdAoCXjk3ahKWs7QHWr4f+gRUL6w34Dv6SeRnR3L47EWeTO6SZ7qLkrAnQ7Co8fCUcCbaio4lObrNFPaTvnSP2pGvqEWESvxBROM5AJCLBtiJ+a8NHt0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - check-counter: {} - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b58f2c18636eb10faa77ed3614abd00cb85dfc2c timestamp: 2022-09-13_04:17:04 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.14413 2022-09-17T10:16:54.001 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_9f1013ad23aaca59f081f4d35bc048be3d0598b7/qa; will attempt to use it 2022-09-17T10:16:54.003 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_9f1013ad23aaca59f081f4d35bc048be3d0598b7/qa/tasks 2022-09-17T10:16:54.003 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-09-17T10:16:54.006 INFO:teuthology.task.internal:Checking packages... 2022-09-17T10:16:54.034 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '9f1013ad23aaca59f081f4d35bc048be3d0598b7' 2022-09-17T10:16:54.034 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-09-17T10:16:54.035 INFO:teuthology.packaging:ref: None 2022-09-17T10:16:54.035 INFO:teuthology.packaging:tag: None 2022-09-17T10:16:54.035 INFO:teuthology.packaging:branch: pacific 2022-09-17T10:16:54.036 INFO:teuthology.packaging:sha1: 9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:16:54.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2022-09-17T10:16:54.287 INFO:teuthology.task.internal:Found packages for ceph version 16.2.10-836.ga0205976 2022-09-17T10:16:54.287 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-09-17T10:16:54.296 INFO:teuthology.task.internal:no buildpackages task found 2022-09-17T10:16:54.296 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-09-17T10:16:54.306 INFO:teuthology.task.internal:Saving configuration 2022-09-17T10:16:54.327 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-09-17T10:16:54.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-17T10:16:54.374 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi/7030120', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-17 10:11:43.500555', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDuOxaiKZtrfPZNz7MRCotPB1w3QVNFv3eU9WfumShDZBPWsY+b9RaUTQ/S1wWUIW9ljKs/4JW6+/1do7jTJPoA='} 2022-09-17T10:16:54.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi/7030120', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-17 10:11:43.502097', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAgF2aAfQ8y7i3mV+n+XZplFr7JKFftsqlGd2J/4g3mGcX0NhMy0UajgwB1+E/zF5RT1rbTYE1Ye69XKPz599j8='} 2022-09-17T10:16:54.425 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi/7030120', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-17 10:11:43.503250', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXW8oRMpZpgDWHIzdVkGfd6SuaRwyphqhtm+J5f/N/hQb1ocU843JH9FCYT4F0yhdxpri4GEPHlENY/dxxeD0o='} 2022-09-17T10:16:54.426 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-09-17T10:16:54.444 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2022-09-17T10:16:54.445 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2022-09-17T10:16:54.445 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2022-09-17T10:16:54.445 INFO:teuthology.run_tasks:Running task console_log... 2022-09-17T10:16:54.579 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f72705578c8>, signals=[15]) 2022-09-17T10:16:54.581 INFO:teuthology.run_tasks:Running task internal.connect... 2022-09-17T10:16:54.603 INFO:teuthology.task.internal:Opening connections... 2022-09-17T10:16:54.603 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2022-09-17T10:16:54.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-17T10:16:54.707 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2022-09-17T10:16:54.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-17T10:16:54.797 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2022-09-17T10:16:54.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-17T10:16:54.878 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-09-17T10:16:54.893 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2022-09-17T10:16:54.915 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2022-09-17T10:16:54.916 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2022-09-17T10:16:54.973 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2022-09-17T10:16:54.973 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.4 (Ootpa)" 2022-09-17T10:16:54.973 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2022-09-17T10:16:54.974 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2022-09-17T10:16:54.974 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.4" 2022-09-17T10:16:54.975 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2022-09-17T10:16:54.975 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-09-17T10:16:54.975 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2022-09-17T10:16:54.975 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-09-17T10:16:54.975 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2022-09-17T10:16:54.976 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-17T10:16:54.976 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-17T10:16:54.976 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:16:54.976 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-17T10:16:54.977 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-09-17T10:16:54.977 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-17T10:16:54.977 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-09-17T10:16:54.978 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2022-09-17T10:16:54.998 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2022-09-17T10:16:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2022-09-17T10:16:55.017 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2022-09-17T10:16:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2022-09-17T10:16:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.4 (Ootpa)" 2022-09-17T10:16:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2022-09-17T10:16:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2022-09-17T10:16:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.4" 2022-09-17T10:16:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2022-09-17T10:16:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-09-17T10:16:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2022-09-17T10:16:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-09-17T10:16:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2022-09-17T10:16:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-17T10:16:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-17T10:16:55.079 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:16:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-17T10:16:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-09-17T10:16:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-17T10:16:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-09-17T10:16:55.081 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2022-09-17T10:16:55.111 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2022-09-17T10:16:55.131 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2022-09-17T10:16:55.131 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2022-09-17T10:16:55.190 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux" 2022-09-17T10:16:55.190 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.4 (Ootpa)" 2022-09-17T10:16:55.191 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel" 2022-09-17T10:16:55.191 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora" 2022-09-17T10:16:55.191 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.4" 2022-09-17T10:16:55.191 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2022-09-17T10:16:55.192 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-09-17T10:16:55.192 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2022-09-17T10:16:55.192 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-09-17T10:16:55.193 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/" 2022-09-17T10:16:55.193 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-17T10:16:55.193 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-17T10:16:55.193 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:16:55.193 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-17T10:16:55.194 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-09-17T10:16:55.194 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-17T10:16:55.194 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-09-17T10:16:55.195 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2022-09-17T10:16:55.223 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-09-17T10:16:55.247 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-09-17T10:16:55.260 INFO:teuthology.task.internal:Checking for old test directory... 2022-09-17T10:16:55.260 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2022-09-17T10:16:55.264 DEBUG:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2022-09-17T10:16:55.267 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2022-09-17T10:16:55.284 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-09-17T10:16:55.296 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-09-17T10:16:55.297 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2022-09-17T10:16:55.322 DEBUG:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2022-09-17T10:16:55.326 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2022-09-17T10:16:55.348 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-09-17T10:16:55.467 INFO:teuthology.run_tasks:Running task kernel... 2022-09-17T10:16:55.483 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2022-09-17T10:16:55.484 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2022-09-17T10:16:55.484 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2022-09-17T10:16:55.485 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-17T10:16:55.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-17T10:16:55.504 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2022-09-17T10:16:55.562 INFO:teuthology.orchestra.run.smithi062.stdout:4.18.0-372.19.1.el8_6.x86_64 2022-09-17T10:16:55.562 INFO:teuthology.task.kernel:Running kernel on smithi062: 4.18.0-372.19.1.el8_6.x86_64 2022-09-17T10:16:55.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2022-09-17T10:16:56.909 INFO:teuthology.orchestra.run.smithi062.stdout:Updating Subscription Management repositories. 2022-09-17T10:16:56.909 INFO:teuthology.orchestra.run.smithi062.stdout:Unable to read consumer identity 2022-09-17T10:16:56.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:16:56.996 INFO:teuthology.orchestra.run.smithi062.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-09-17T10:16:56.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:16:58.411 INFO:teuthology.orchestra.run.smithi062.stdout:Copr repo for python3-asyncssh owned by ceph 36 kB/s | 3.5 kB 00:00 2022-09-17T10:16:59.201 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 17 MB/s | 13 MB 00:00 2022-09-17T10:17:01.975 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2022-09-17T10:17:02.614 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-4.18.0-305.el8.x86_64 is already installed. 2022-09-17T10:17:02.614 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-4.18.0-372.19.1.el8_6.x86_64 is already installed. 2022-09-17T10:17:02.742 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2022-09-17T10:17:02.744 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2022-09-17T10:17:02.744 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2022-09-17T10:17:02.875 DEBUG:teuthology.orchestra.run.smithi062:> echo no | sudo yum reinstall kernel || true 2022-09-17T10:17:03.250 INFO:teuthology.orchestra.run.smithi062.stdout:Updating Subscription Management repositories. 2022-09-17T10:17:03.251 INFO:teuthology.orchestra.run.smithi062.stdout:Unable to read consumer identity 2022-09-17T10:17:03.289 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:17:03.289 INFO:teuthology.orchestra.run.smithi062.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-09-17T10:17:03.290 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:17:03.541 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:02 ago on Sat 17 Sep 2022 10:17:01 AM UTC. 2022-09-17T10:17:03.678 INFO:teuthology.orchestra.run.smithi062.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2022-09-17T10:17:03.679 INFO:teuthology.orchestra.run.smithi062.stdout:Installed package kernel-4.18.0-372.19.1.el8_6.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2022-09-17T10:17:03.720 INFO:teuthology.orchestra.run.smithi062.stderr:Error: No packages marked for reinstall. 2022-09-17T10:17:03.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum reinstall -y kernel || true 2022-09-17T10:17:04.100 INFO:teuthology.orchestra.run.smithi062.stdout:Updating Subscription Management repositories. 2022-09-17T10:17:04.100 INFO:teuthology.orchestra.run.smithi062.stdout:Unable to read consumer identity 2022-09-17T10:17:04.150 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:17:04.150 INFO:teuthology.orchestra.run.smithi062.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2022-09-17T10:17:04.150 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:17:04.409 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:03 ago on Sat 17 Sep 2022 10:17:01 AM UTC. 2022-09-17T10:17:04.551 INFO:teuthology.orchestra.run.smithi062.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2022-09-17T10:17:04.551 INFO:teuthology.orchestra.run.smithi062.stdout:Installed package kernel-4.18.0-372.19.1.el8_6.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2022-09-17T10:17:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:Error: No packages marked for reinstall. 2022-09-17T10:17:04.624 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel --last | head -n 1 2022-09-17T10:17:04.757 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-4.18.0-372.19.1.el8_6.x86_64 Sun 11 Sep 2022 12:11:59 PM UTC 2022-09-17T10:17:04.759 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.19.1.el8_6.x86_64 2022-09-17T10:17:04.760 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-09-17T10:17:04.761 DEBUG:teuthology.parallel:result is None 2022-09-17T10:17:04.761 INFO:teuthology.run_tasks:Running task internal.base... 2022-09-17T10:17:04.800 INFO:teuthology.task.internal:Creating test directory... 2022-09-17T10:17:04.801 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-17T10:17:04.804 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-17T10:17:04.807 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-17T10:17:04.824 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-09-17T10:17:04.835 INFO:teuthology.run_tasks:Running task internal.archive... 2022-09-17T10:17:04.854 INFO:teuthology.task.internal:Creating archive directory... 2022-09-17T10:17:04.854 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-17T10:17:04.859 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-17T10:17:04.866 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-17T10:17:04.909 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-09-17T10:17:04.920 INFO:teuthology.task.internal:Enabling coredump saving... 2022-09-17T10:17:04.921 DEBUG:teuthology.orchestra.run.smithi093:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-17T10:17:04.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-17T10:17:04.950 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-17T10:17:04.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-17T10:17:04.968 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-17T10:17:04.971 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-17T10:17:04.993 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-17T10:17:05.022 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-17T10:17:05.040 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-17T10:17:05.041 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-17T10:17:05.049 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-17T10:17:05.059 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-17T10:17:05.063 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-17T10:17:05.065 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-09-17T10:17:05.076 INFO:teuthology.task.internal:Configuring sudo... 2022-09-17T10:17:05.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-17T10:17:05.078 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-17T10:17:05.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-17T10:17:05.132 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-09-17T10:17:05.145 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-09-17T10:17:05.145 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-17T10:17:05.148 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-17T10:17:05.151 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-17T10:17:05.188 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-17T10:17:05.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-17T10:17:05.293 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-17T10:17:05.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-17T10:17:05.416 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:17:05.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-17T10:17:05.481 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-17T10:17:05.536 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-17T10:17:05.584 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-17T10:17:05.677 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-17T10:17:05.711 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:17:05.711 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-17T10:17:05.777 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-17T10:17:05.825 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-17T10:17:05.882 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-17T10:17:05.967 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-17T10:17:06.009 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:17:06.010 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-17T10:17:06.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2022-09-17T10:17:06.081 DEBUG:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2022-09-17T10:17:06.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2022-09-17T10:17:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-17T10:17:06.132 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-17T10:17:06.173 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-17T10:17:06.553 INFO:teuthology.run_tasks:Running task internal.timer... 2022-09-17T10:17:06.566 INFO:teuthology.task.internal:Starting timer... 2022-09-17T10:17:06.567 INFO:teuthology.run_tasks:Running task pcp... 2022-09-17T10:17:06.583 INFO:teuthology.run_tasks:Running task selinux... 2022-09-17T10:17:06.598 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-09-17T10:17:06.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2022-09-17T10:17:06.657 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: [ OK ] 2022-09-17T10:17:06.660 DEBUG:teuthology.orchestra.run.smithi093:> sudo service auditd rotate 2022-09-17T10:17:06.755 INFO:teuthology.orchestra.run.smithi093.stdout:Rotating logs: [ OK ] 2022-09-17T10:17:06.759 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2022-09-17T10:17:06.803 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: [ OK ] 2022-09-17T10:17:06.805 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-09-17T10:17:06.805 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2022-09-17T10:17:06.831 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2022-09-17T10:17:06.832 DEBUG:teuthology.orchestra.run.smithi093:> /usr/sbin/getenforce 2022-09-17T10:17:06.854 INFO:teuthology.orchestra.run.smithi093.stdout:Permissive 2022-09-17T10:17:06.855 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2022-09-17T10:17:06.878 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2022-09-17T10:17:06.878 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi093.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2022-09-17T10:17:06.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-17T10:17:06.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-17T10:17:06.912 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-17T10:17:06.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-17T10:17:06.939 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-17T10:17:06.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-17T10:17:06.965 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-09-17T10:17:06.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2022-09-17T10:17:07.028 DEBUG:teuthology.orchestra.run.smithi093:> sudo /usr/sbin/setenforce permissive 2022-09-17T10:17:07.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2022-09-17T10:17:07.082 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-09-17T10:17:07.103 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2022-09-17T10:17:07.104 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-09-17T10:17:07.138 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-09-17T10:17:07.140 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi093.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-09-17T10:24:13.062 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi093.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2022-09-17T10:24:13.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2022-09-17T10:24:13.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-17T10:24:13.164 DEBUG:teuthology.orchestra.run.smithi062:> true 2022-09-17T10:24:13.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2022-09-17T10:24:13.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-17T10:24:13.341 DEBUG:teuthology.orchestra.run.smithi093:> true 2022-09-17T10:24:13.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2022-09-17T10:24:13.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-17T10:24:13.514 DEBUG:teuthology.orchestra.run.smithi159:> true 2022-09-17T10:24:13.576 INFO:teuthology.run_tasks:Running task clock... 2022-09-17T10:24:13.589 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-09-17T10:24:13.590 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-17T10:24:13.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-17T10:24:13.596 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-17T10:24:13.596 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-17T10:24:13.599 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-17T10:24:13.599 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-17T10:24:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-17T10:24:13.631 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-17T10:24:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-17T10:24:13.646 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-17T10:24:13.649 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-17T10:24:13.660 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-17T10:24:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2022-09-17T10:24:13.693 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2022-09-17T10:24:13.694 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2022-09-17T10:24:13.696 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: ntpd: command not found 2022-09-17T10:24:13.704 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2022-09-17T10:24:13.708 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-17T10:24:13.709 INFO:teuthology.orchestra.run.smithi093.stdout:506 Cannot talk to daemon 2022-09-17T10:24:13.719 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-17T10:24:13.730 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-17T10:24:13.730 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-17T10:24:13.732 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-17T10:24:13.742 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-17T10:24:13.791 INFO:teuthology.orchestra.run.smithi062.stderr:bash: ntpq: command not found 2022-09-17T10:24:13.793 INFO:teuthology.orchestra.run.smithi062.stdout:210 Number of sources = 4 2022-09-17T10:24:13.793 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-17T10:24:13.793 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2022-09-17T10:24:13.794 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.794 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.794 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.794 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.795 INFO:teuthology.orchestra.run.smithi159.stderr:bash: ntpq: command not found 2022-09-17T10:24:13.797 INFO:teuthology.orchestra.run.smithi159.stdout:210 Number of sources = 4 2022-09-17T10:24:13.797 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-17T10:24:13.797 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2022-09-17T10:24:13.798 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.798 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.798 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.799 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.809 INFO:teuthology.orchestra.run.smithi093.stderr:bash: ntpq: command not found 2022-09-17T10:24:13.816 INFO:teuthology.orchestra.run.smithi093.stdout:210 Number of sources = 4 2022-09-17T10:24:13.816 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-17T10:24:13.816 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2022-09-17T10:24:13.816 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.817 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.817 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.817 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-17T10:24:13.818 INFO:teuthology.run_tasks:Running task install... 2022-09-17T10:24:13.830 DEBUG:teuthology.task.install:project ceph 2022-09-17T10:24:13.831 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7'}} 2022-09-17T10:24:13.831 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7'} 2022-09-17T10:24:13.832 INFO:teuthology.task.install:Using flavor: default 2022-09-17T10:24:13.845 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-09-17T10:24:13.845 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-09-17T10:24:13.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2022-09-17T10:24:13.889 INFO:teuthology.orchestra.run.smithi062.stdout:RedHatEnterprise 2022-09-17T10:24:13.890 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:24:13.891 DEBUG:teuthology.orchestra.run.smithi093:> sudo lsb_release -is 2022-09-17T10:24:13.891 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7', 'tag': None, 'wait_for_package': False} 2022-09-17T10:24:13.892 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2022-09-17T10:24:13.934 INFO:teuthology.orchestra.run.smithi093.stdout:RedHatEnterprise 2022-09-17T10:24:13.939 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:24:13.939 DEBUG:teuthology.orchestra.run.smithi159:> sudo lsb_release -is 2022-09-17T10:24:13.940 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7', 'tag': None, 'wait_for_package': False} 2022-09-17T10:24:13.940 DEBUG:teuthology.orchestra.run.smithi093:> sudo lsb_release -is 2022-09-17T10:24:13.972 INFO:teuthology.orchestra.run.smithi062.stdout:RedHatEnterprise 2022-09-17T10:24:13.973 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:24:13.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:24:13.981 INFO:teuthology.orchestra.run.smithi159.stdout:RedHatEnterprise 2022-09-17T10:24:13.982 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:24:13.982 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7', 'tag': None, 'wait_for_package': False} 2022-09-17T10:24:13.983 DEBUG:teuthology.orchestra.run.smithi159:> sudo lsb_release -is 2022-09-17T10:24:14.023 INFO:teuthology.orchestra.run.smithi093.stdout:RedHatEnterprise 2022-09-17T10:24:14.024 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:24:14.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:24:14.062 INFO:teuthology.orchestra.run.smithi159.stdout:RedHatEnterprise 2022-09-17T10:24:14.062 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:24:14.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:24:14.153 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/ 2022-09-17T10:24:14.153 INFO:teuthology.task.install.rpm:Package version is 16.2.10-818.g9f1013ad 2022-09-17T10:24:14.194 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/ 2022-09-17T10:24:14.194 INFO:teuthology.task.install.rpm:Package version is 16.2.10-818.g9f1013ad 2022-09-17T10:24:14.233 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/ 2022-09-17T10:24:14.233 INFO:teuthology.task.install.rpm:Package version is 16.2.10-818.g9f1013ad 2022-09-17T10:24:14.281 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-17T10:24:14.282 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:24:14.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-17T10:24:14.309 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-09-17T10:24:14.310 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9f1013ad23aaca59f081f4d35bc048be3d0598b7/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-17T10:24:14.328 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-17T10:24:14.329 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:24:14.329 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-17T10:24:14.354 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/9f1013ad23aaca59f081f4d35bc048be3d0598b7/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-17T10:24:14.355 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:24:14.356 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-17T10:24:14.359 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-09-17T10:24:14.360 DEBUG:teuthology.orchestra.run.smithi093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9f1013ad23aaca59f081f4d35bc048be3d0598b7/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-17T10:24:14.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-17T10:24:14.385 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-09-17T10:24:14.386 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9f1013ad23aaca59f081f4d35bc048be3d0598b7/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-17T10:24:14.427 DEBUG:teuthology.orchestra.run.smithi093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-17T10:24:14.452 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-17T10:24:14.463 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-17T10:24:14.503 DEBUG:teuthology.orchestra.run.smithi093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-17T10:24:14.527 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-17T10:24:14.528 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2022-09-17T10:24:14.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2022-09-17T10:24:14.567 INFO:teuthology.orchestra.run.smithi093.stdout:check_obsoletes = 1 2022-09-17T10:24:14.568 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum clean all 2022-09-17T10:24:14.591 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2022-09-17T10:24:14.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2022-09-17T10:24:14.903 INFO:teuthology.orchestra.run.smithi062.stdout:Updating Subscription Management repositories. 2022-09-17T10:24:14.928 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2022-09-17T10:24:14.951 INFO:teuthology.orchestra.run.smithi159.stdout:Updating Subscription Management repositories. 2022-09-17T10:24:15.216 INFO:teuthology.orchestra.run.smithi062.stdout:54 files removed 2022-09-17T10:24:15.225 INFO:teuthology.orchestra.run.smithi093.stdout:54 files removed 2022-09-17T10:24:15.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-09-17T10:24:15.271 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-09-17T10:24:15.285 INFO:teuthology.orchestra.run.smithi159.stdout:54 files removed 2022-09-17T10:24:15.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-09-17T10:24:15.588 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2022-09-17T10:24:15.593 INFO:teuthology.orchestra.run.smithi062.stdout:Updating Subscription Management repositories. 2022-09-17T10:24:15.649 INFO:teuthology.orchestra.run.smithi159.stdout:Updating Subscription Management repositories. 2022-09-17T10:24:16.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph packages for x86_64 316 kB/s | 76 kB 00:00 2022-09-17T10:24:16.296 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 319 kB/s | 76 kB 00:00 2022-09-17T10:24:16.354 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 318 kB/s | 76 kB 00:00 2022-09-17T10:24:16.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph noarch packages 77 kB/s | 15 kB 00:00 2022-09-17T10:24:16.534 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 77 kB/s | 15 kB 00:00 2022-09-17T10:24:16.586 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 77 kB/s | 15 kB 00:00 2022-09-17T10:24:16.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph source packages 7.1 kB/s | 1.4 kB 00:00 2022-09-17T10:24:16.758 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 7.2 kB/s | 1.4 kB 00:00 2022-09-17T10:24:16.811 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 7.2 kB/s | 1.4 kB 00:00 2022-09-17T10:24:16.857 INFO:teuthology.orchestra.run.smithi062.stdout:Copr repo for python3-asyncssh owned by ceph 47 kB/s | 3.5 kB 00:00 2022-09-17T10:24:16.858 INFO:teuthology.orchestra.run.smithi093.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2022-09-17T10:24:16.920 INFO:teuthology.orchestra.run.smithi159.stdout:Copr repo for python3-asyncssh owned by ceph 40 kB/s | 3.5 kB 00:00 2022-09-17T10:24:17.615 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 18 MB/s | 13 MB 00:00 2022-09-17T10:24:17.663 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 17 MB/s | 13 MB 00:00 2022-09-17T10:24:17.706 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 17 MB/s | 13 MB 00:00 2022-09-17T10:24:20.272 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2022-09-17T10:24:20.319 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2022-09-17T10:24:20.459 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2022-09-17T10:24:20.566 INFO:teuthology.orchestra.run.smithi093.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 171 MB/s | 38 MB 00:00 2022-09-17T10:24:20.625 INFO:teuthology.orchestra.run.smithi159.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 160 MB/s | 38 MB 00:00 2022-09-17T10:24:20.749 INFO:teuthology.orchestra.run.smithi062.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 153 MB/s | 33 MB 00:00 2022-09-17T10:24:25.969 INFO:teuthology.orchestra.run.smithi093.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 163 MB/s | 33 MB 00:00 2022-09-17T10:24:26.015 INFO:teuthology.orchestra.run.smithi159.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 150 MB/s | 33 MB 00:00 2022-09-17T10:24:26.155 INFO:teuthology.orchestra.run.smithi062.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 158 MB/s | 38 MB 00:00 2022-09-17T10:24:33.870 INFO:teuthology.orchestra.run.smithi093.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-17T10:24:33.871 INFO:teuthology.orchestra.run.smithi093.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-17T10:24:33.882 INFO:teuthology.orchestra.run.smithi093.stdout:Package NetworkManager-1:1.30.0-7.el8.x86_64 is already installed. 2022-09-17T10:24:33.884 INFO:teuthology.orchestra.run.smithi093.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2022-09-17T10:24:33.885 INFO:teuthology.orchestra.run.smithi093.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2022-09-17T10:24:33.885 INFO:teuthology.orchestra.run.smithi093.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-17T10:24:33.886 INFO:teuthology.orchestra.run.smithi093.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-17T10:24:33.888 INFO:teuthology.orchestra.run.smithi093.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-09-17T10:24:33.889 INFO:teuthology.orchestra.run.smithi093.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2022-09-17T10:24:33.999 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-17T10:24:34.000 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-17T10:24:34.010 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.30.0-7.el8.x86_64 is already installed. 2022-09-17T10:24:34.011 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2022-09-17T10:24:34.012 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2022-09-17T10:24:34.013 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-17T10:24:34.014 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-17T10:24:34.018 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-09-17T10:24:34.018 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2022-09-17T10:24:34.357 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2022-09-17T10:24:34.367 INFO:teuthology.orchestra.run.smithi093.stdout:====================================================================================================================== 2022-09-17T10:24:34.368 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2022-09-17T10:24:34.368 INFO:teuthology.orchestra.run.smithi093.stdout:====================================================================================================================== 2022-09-17T10:24:34.368 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2022-09-17T10:24:34.368 INFO:teuthology.orchestra.run.smithi093.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-09-17T10:24:34.369 INFO:teuthology.orchestra.run.smithi093.stdout: ceph x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 6.4 k 2022-09-17T10:24:34.369 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 6.1 M 2022-09-17T10:24:34.369 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 904 k 2022-09-17T10:24:34.369 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 161 k 2022-09-17T10:24:34.370 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 1.6 M 2022-09-17T10:24:34.370 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 113 k 2022-09-17T10:24:34.370 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 3.1 M 2022-09-17T10:24:34.370 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 8.6 M 2022-09-17T10:24:34.371 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 27 k 2022-09-17T10:24:34.371 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 12 M 2022-09-17T10:24:34.371 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 52 M 2022-09-17T10:24:34.371 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 82 k 2022-09-17T10:24:34.372 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-mirror x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 256 k 2022-09-17T10:24:34.372 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-top noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 14 k 2022-09-17T10:24:34.376 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-09-17T10:24:34.377 INFO:teuthology.orchestra.run.smithi093.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-09-17T10:24:34.377 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-09-17T10:24:34.377 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 25 k 2022-09-17T10:24:34.378 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 818 k 2022-09-17T10:24:34.378 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 131 k 2022-09-17T10:24:34.378 INFO:teuthology.orchestra.run.smithi093.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-09-17T10:24:34.378 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-09-17T10:24:34.379 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-09-17T10:24:34.379 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 216 k 2022-09-17T10:24:34.379 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 387 k 2022-09-17T10:24:34.379 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 368 k 2022-09-17T10:24:34.380 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 114 k 2022-09-17T10:24:34.380 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 88 k 2022-09-17T10:24:34.380 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.7 M 2022-09-17T10:24:34.380 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 173 k 2022-09-17T10:24:34.381 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-09-17T10:24:34.381 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrading: 2022-09-17T10:24:34.381 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-09-17T10:24:34.381 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-libnm x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-09-17T10:24:34.381 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-team x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 146 k 2022-09-17T10:24:34.382 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-tui x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 329 k 2022-09-17T10:24:34.382 INFO:teuthology.orchestra.run.smithi093.stdout: librados2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.7 M 2022-09-17T10:24:34.382 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 4.2 M 2022-09-17T10:24:34.383 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2022-09-17T10:24:34.383 INFO:teuthology.orchestra.run.smithi093.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-09-17T10:24:34.383 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 24 M 2022-09-17T10:24:34.383 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 24 k 2022-09-17T10:24:34.383 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 2.4 M 2022-09-17T10:24:34.384 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 241 k 2022-09-17T10:24:34.384 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 5.0 M 2022-09-17T10:24:34.384 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 18 M 2022-09-17T10:24:34.384 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 15 k 2022-09-17T10:24:34.385 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 26 k 2022-09-17T10:24:34.385 INFO:teuthology.orchestra.run.smithi093.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-09-17T10:24:34.385 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-17T10:24:34.385 INFO:teuthology.orchestra.run.smithi093.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-09-17T10:24:34.386 INFO:teuthology.orchestra.run.smithi093.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-09-17T10:24:34.386 INFO:teuthology.orchestra.run.smithi093.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-17T10:24:34.387 INFO:teuthology.orchestra.run.smithi093.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-09-17T10:24:34.387 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 173 k 2022-09-17T10:24:34.388 INFO:teuthology.orchestra.run.smithi093.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-09-17T10:24:34.388 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2022-09-17T10:24:34.389 INFO:teuthology.orchestra.run.smithi093.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-17T10:24:34.389 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2022-09-17T10:24:34.389 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-09-17T10:24:34.390 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 493 k 2022-09-17T10:24:34.390 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-09-17T10:24:34.391 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.8 M 2022-09-17T10:24:34.391 INFO:teuthology.orchestra.run.smithi093.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-09-17T10:24:34.392 INFO:teuthology.orchestra.run.smithi093.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2022-09-17T10:24:34.392 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-17T10:24:34.393 INFO:teuthology.orchestra.run.smithi093.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-09-17T10:24:34.393 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-09-17T10:24:34.394 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-09-17T10:24:34.394 INFO:teuthology.orchestra.run.smithi093.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-09-17T10:24:34.395 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-09-17T10:24:34.395 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-09-17T10:24:34.396 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-09-17T10:24:34.396 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-09-17T10:24:34.396 INFO:teuthology.orchestra.run.smithi093.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-09-17T10:24:34.397 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-09-17T10:24:34.397 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-17T10:24:34.398 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-17T10:24:34.398 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-17T10:24:34.399 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 45 k 2022-09-17T10:24:34.399 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 96 k 2022-09-17T10:24:34.400 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-17T10:24:34.400 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-09-17T10:24:34.400 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-17T10:24:34.401 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-17T10:24:34.401 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-17T10:24:34.402 INFO:teuthology.orchestra.run.smithi093.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-09-17T10:24:34.402 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-17T10:24:34.403 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-17T10:24:34.403 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-17T10:24:34.404 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2022-09-17T10:24:34.404 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-09-17T10:24:34.404 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-09-17T10:24:34.405 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-17T10:24:34.405 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-17T10:24:34.406 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-17T10:24:34.406 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-09-17T10:24:34.407 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-09-17T10:24:34.407 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-17T10:24:34.407 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-09-17T10:24:34.407 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-09-17T10:24:34.408 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-09-17T10:24:34.408 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-17T10:24:34.408 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-17T10:24:34.408 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-09-17T10:24:34.409 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-09-17T10:24:34.409 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-09-17T10:24:34.409 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-09-17T10:24:34.409 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-09-17T10:24:34.410 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-17T10:24:34.410 INFO:teuthology.orchestra.run.smithi093.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-09-17T10:24:34.410 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-17T10:24:34.410 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-17T10:24:34.410 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-17T10:24:34.411 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-17T10:24:34.411 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2022-09-17T10:24:34.411 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-17T10:24:34.411 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-17T10:24:34.412 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-17T10:24:34.412 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-17T10:24:34.412 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-17T10:24:34.412 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-17T10:24:34.413 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-17T10:24:34.413 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-17T10:24:34.413 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-09-17T10:24:34.413 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-17T10:24:34.414 INFO:teuthology.orchestra.run.smithi093.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2022-09-17T10:24:34.414 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-09-17T10:24:34.414 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-09-17T10:24:34.414 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:24:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2022-09-17T10:24:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:====================================================================================================================== 2022-09-17T10:24:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Install 122 Packages 2022-09-17T10:24:34.415 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrade 6 Packages 2022-09-17T10:24:34.415 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:24:34.416 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 206 M 2022-09-17T10:24:34.417 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2022-09-17T10:24:34.481 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2022-09-17T10:24:34.493 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================================================== 2022-09-17T10:24:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2022-09-17T10:24:34.493 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================================================== 2022-09-17T10:24:34.494 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2022-09-17T10:24:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-09-17T10:24:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 6.4 k 2022-09-17T10:24:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 6.1 M 2022-09-17T10:24:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 904 k 2022-09-17T10:24:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 161 k 2022-09-17T10:24:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 1.6 M 2022-09-17T10:24:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 113 k 2022-09-17T10:24:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 3.1 M 2022-09-17T10:24:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 8.6 M 2022-09-17T10:24:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 27 k 2022-09-17T10:24:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 12 M 2022-09-17T10:24:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 52 M 2022-09-17T10:24:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 82 k 2022-09-17T10:24:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 256 k 2022-09-17T10:24:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 14 k 2022-09-17T10:24:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-09-17T10:24:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-09-17T10:24:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-09-17T10:24:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 25 k 2022-09-17T10:24:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 818 k 2022-09-17T10:24:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 131 k 2022-09-17T10:24:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-09-17T10:24:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-09-17T10:24:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-09-17T10:24:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 216 k 2022-09-17T10:24:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 387 k 2022-09-17T10:24:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 368 k 2022-09-17T10:24:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 114 k 2022-09-17T10:24:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 88 k 2022-09-17T10:24:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.7 M 2022-09-17T10:24:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 173 k 2022-09-17T10:24:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-09-17T10:24:34.502 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2022-09-17T10:24:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-09-17T10:24:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-09-17T10:24:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 146 k 2022-09-17T10:24:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 329 k 2022-09-17T10:24:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.7 M 2022-09-17T10:24:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 4.2 M 2022-09-17T10:24:34.503 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2022-09-17T10:24:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-09-17T10:24:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 24 M 2022-09-17T10:24:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 24 k 2022-09-17T10:24:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 2.4 M 2022-09-17T10:24:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 241 k 2022-09-17T10:24:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 5.0 M 2022-09-17T10:24:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 18 M 2022-09-17T10:24:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 15 k 2022-09-17T10:24:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 26 k 2022-09-17T10:24:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-09-17T10:24:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-17T10:24:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-09-17T10:24:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-09-17T10:24:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-17T10:24:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-09-17T10:24:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 173 k 2022-09-17T10:24:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-09-17T10:24:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2022-09-17T10:24:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-17T10:24:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2022-09-17T10:24:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-09-17T10:24:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 493 k 2022-09-17T10:24:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-09-17T10:24:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.8 M 2022-09-17T10:24:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-09-17T10:24:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2022-09-17T10:24:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-17T10:24:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-09-17T10:24:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-09-17T10:24:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-09-17T10:24:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-09-17T10:24:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-09-17T10:24:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-09-17T10:24:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-09-17T10:24:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-09-17T10:24:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-09-17T10:24:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-09-17T10:24:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-17T10:24:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-17T10:24:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-17T10:24:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 45 k 2022-09-17T10:24:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 96 k 2022-09-17T10:24:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-17T10:24:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-09-17T10:24:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-17T10:24:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-17T10:24:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-17T10:24:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-09-17T10:24:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-17T10:24:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-17T10:24:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-17T10:24:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2022-09-17T10:24:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-09-17T10:24:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-09-17T10:24:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-17T10:24:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-17T10:24:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-17T10:24:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-09-17T10:24:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-09-17T10:24:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-17T10:24:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-09-17T10:24:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-09-17T10:24:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-09-17T10:24:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-17T10:24:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-17T10:24:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-09-17T10:24:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-09-17T10:24:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-09-17T10:24:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-09-17T10:24:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-09-17T10:24:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-17T10:24:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-09-17T10:24:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-17T10:24:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-17T10:24:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-17T10:24:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-17T10:24:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2022-09-17T10:24:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-17T10:24:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-17T10:24:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-17T10:24:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-17T10:24:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-17T10:24:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-17T10:24:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-17T10:24:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-17T10:24:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-09-17T10:24:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-17T10:24:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2022-09-17T10:24:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-09-17T10:24:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-09-17T10:24:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:24:34.525 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2022-09-17T10:24:34.525 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================================================== 2022-09-17T10:24:34.525 INFO:teuthology.orchestra.run.smithi159.stdout:Install 122 Packages 2022-09-17T10:24:34.525 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 6 Packages 2022-09-17T10:24:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:24:34.526 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 206 M 2022-09-17T10:24:34.527 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2022-09-17T10:24:34.585 INFO:teuthology.orchestra.run.smithi093.stdout:(1/128): ceph-16.2.10-818.g9f1013ad.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2022-09-17T10:24:34.705 INFO:teuthology.orchestra.run.smithi159.stdout:(1/128): ceph-16.2.10-818.g9f1013ad.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2022-09-17T10:24:34.990 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-17T10:24:34.991 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-17T10:24:35.003 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.30.0-7.el8.x86_64 is already installed. 2022-09-17T10:24:35.003 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2022-09-17T10:24:35.004 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2022-09-17T10:24:35.006 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-17T10:24:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-17T10:24:35.011 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-09-17T10:24:35.012 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2022-09-17T10:24:35.378 INFO:teuthology.orchestra.run.smithi093.stdout:(2/128): ceph-fuse-16.2.10-818.g9f1013ad.el8.x8 1.1 MB/s | 904 kB 00:00 2022-09-17T10:24:35.500 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2022-09-17T10:24:35.511 INFO:teuthology.orchestra.run.smithi093.stdout:(3/128): ceph-immutable-object-cache-16.2.10-81 1.2 MB/s | 161 kB 00:00 2022-09-17T10:24:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================================================== 2022-09-17T10:24:35.524 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2022-09-17T10:24:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================================================== 2022-09-17T10:24:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2022-09-17T10:24:35.525 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-09-17T10:24:35.525 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 6.4 k 2022-09-17T10:24:35.525 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 6.1 M 2022-09-17T10:24:35.525 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 904 k 2022-09-17T10:24:35.526 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 161 k 2022-09-17T10:24:35.526 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 1.6 M 2022-09-17T10:24:35.526 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 113 k 2022-09-17T10:24:35.526 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 3.1 M 2022-09-17T10:24:35.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 8.6 M 2022-09-17T10:24:35.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 27 k 2022-09-17T10:24:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 12 M 2022-09-17T10:24:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 52 M 2022-09-17T10:24:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 82 k 2022-09-17T10:24:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 256 k 2022-09-17T10:24:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 14 k 2022-09-17T10:24:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-09-17T10:24:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-09-17T10:24:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-09-17T10:24:35.530 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 25 k 2022-09-17T10:24:35.530 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 818 k 2022-09-17T10:24:35.530 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 131 k 2022-09-17T10:24:35.530 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-09-17T10:24:35.531 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-09-17T10:24:35.531 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-09-17T10:24:35.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 216 k 2022-09-17T10:24:35.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 387 k 2022-09-17T10:24:35.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 368 k 2022-09-17T10:24:35.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 114 k 2022-09-17T10:24:35.532 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 88 k 2022-09-17T10:24:35.532 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.7 M 2022-09-17T10:24:35.533 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 173 k 2022-09-17T10:24:35.533 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-09-17T10:24:35.533 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2022-09-17T10:24:35.533 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-09-17T10:24:35.533 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-09-17T10:24:35.534 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 146 k 2022-09-17T10:24:35.534 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui x86_64 1:1.30.0-13.el8_4 rhel-8-for-x86_64-baseos-rpms 329 k 2022-09-17T10:24:35.534 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.7 M 2022-09-17T10:24:35.534 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 4.2 M 2022-09-17T10:24:35.535 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2022-09-17T10:24:35.535 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-09-17T10:24:35.535 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 24 M 2022-09-17T10:24:35.535 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 24 k 2022-09-17T10:24:35.536 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 2.4 M 2022-09-17T10:24:35.536 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 241 k 2022-09-17T10:24:35.536 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 5.0 M 2022-09-17T10:24:35.536 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 18 M 2022-09-17T10:24:35.537 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:16.2.10-818.g9f1013ad.el8 ceph-noarch 15 k 2022-09-17T10:24:35.537 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 26 k 2022-09-17T10:24:35.537 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-09-17T10:24:35.539 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-17T10:24:35.540 INFO:teuthology.orchestra.run.smithi062.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-09-17T10:24:35.541 INFO:teuthology.orchestra.run.smithi062.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-09-17T10:24:35.541 INFO:teuthology.orchestra.run.smithi062.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-17T10:24:35.542 INFO:teuthology.orchestra.run.smithi062.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-09-17T10:24:35.542 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 173 k 2022-09-17T10:24:35.543 INFO:teuthology.orchestra.run.smithi062.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-09-17T10:24:35.543 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2022-09-17T10:24:35.544 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-17T10:24:35.544 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2022-09-17T10:24:35.544 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-09-17T10:24:35.544 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 493 k 2022-09-17T10:24:35.545 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-09-17T10:24:35.545 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 3.8 M 2022-09-17T10:24:35.545 INFO:teuthology.orchestra.run.smithi062.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-09-17T10:24:35.546 INFO:teuthology.orchestra.run.smithi062.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2022-09-17T10:24:35.546 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-17T10:24:35.547 INFO:teuthology.orchestra.run.smithi062.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-09-17T10:24:35.547 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-09-17T10:24:35.547 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-09-17T10:24:35.548 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-09-17T10:24:35.548 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-09-17T10:24:35.548 INFO:teuthology.orchestra.run.smithi062.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-09-17T10:24:35.549 INFO:teuthology.orchestra.run.smithi062.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-09-17T10:24:35.549 INFO:teuthology.orchestra.run.smithi062.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-09-17T10:24:35.549 INFO:teuthology.orchestra.run.smithi062.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-09-17T10:24:35.549 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-09-17T10:24:35.550 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-17T10:24:35.550 INFO:teuthology.orchestra.run.smithi062.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-17T10:24:35.550 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-17T10:24:35.550 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 45 k 2022-09-17T10:24:35.551 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:16.2.10-818.g9f1013ad.el8 ceph 96 k 2022-09-17T10:24:35.551 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-17T10:24:35.551 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-09-17T10:24:35.551 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-17T10:24:35.552 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-17T10:24:35.552 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-17T10:24:35.552 INFO:teuthology.orchestra.run.smithi062.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-09-17T10:24:35.552 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-17T10:24:35.553 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-17T10:24:35.553 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-17T10:24:35.553 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2022-09-17T10:24:35.553 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-09-17T10:24:35.554 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-09-17T10:24:35.554 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-17T10:24:35.555 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-17T10:24:35.555 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-17T10:24:35.555 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-09-17T10:24:35.556 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-09-17T10:24:35.556 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-17T10:24:35.557 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-09-17T10:24:35.557 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-09-17T10:24:35.558 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-09-17T10:24:35.559 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-17T10:24:35.559 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-17T10:24:35.560 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-09-17T10:24:35.560 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-09-17T10:24:35.561 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-09-17T10:24:35.561 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-09-17T10:24:35.562 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-09-17T10:24:35.562 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-17T10:24:35.563 INFO:teuthology.orchestra.run.smithi062.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-09-17T10:24:35.563 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-17T10:24:35.563 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-17T10:24:35.564 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-17T10:24:35.564 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-17T10:24:35.564 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2022-09-17T10:24:35.564 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-17T10:24:35.565 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-17T10:24:35.565 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-17T10:24:35.565 INFO:teuthology.orchestra.run.smithi062.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-17T10:24:35.566 INFO:teuthology.orchestra.run.smithi062.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-17T10:24:35.566 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-17T10:24:35.567 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-17T10:24:35.567 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-17T10:24:35.567 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-09-17T10:24:35.568 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-17T10:24:35.568 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2022-09-17T10:24:35.569 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-09-17T10:24:35.569 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-09-17T10:24:35.570 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:24:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2022-09-17T10:24:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================================================== 2022-09-17T10:24:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:Install 122 Packages 2022-09-17T10:24:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 6 Packages 2022-09-17T10:24:35.572 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:24:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 206 M 2022-09-17T10:24:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2022-09-17T10:24:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:(1/128): ceph-16.2.10-818.g9f1013ad.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2022-09-17T10:24:36.027 INFO:teuthology.orchestra.run.smithi159.stdout:(2/128): ceph-fuse-16.2.10-818.g9f1013ad.el8.x8 684 kB/s | 904 kB 00:01 2022-09-17T10:24:36.241 INFO:teuthology.orchestra.run.smithi159.stdout:(3/128): ceph-immutable-object-cache-16.2.10-81 754 kB/s | 161 kB 00:00 2022-09-17T10:24:36.469 INFO:teuthology.orchestra.run.smithi062.stdout:(2/128): ceph-fuse-16.2.10-818.g9f1013ad.el8.x8 1.3 MB/s | 904 kB 00:00 2022-09-17T10:24:36.545 INFO:teuthology.orchestra.run.smithi062.stdout:(3/128): ceph-immutable-object-cache-16.2.10-81 2.0 MB/s | 161 kB 00:00 2022-09-17T10:24:37.591 INFO:teuthology.orchestra.run.smithi062.stdout:(4/128): ceph-mds-16.2.10-818.g9f1013ad.el8.x86 2.3 MB/s | 2.4 MB 00:01 2022-09-17T10:24:37.648 INFO:teuthology.orchestra.run.smithi093.stdout:(4/128): ceph-mds-16.2.10-818.g9f1013ad.el8.x86 1.1 MB/s | 2.4 MB 00:02 2022-09-17T10:24:38.290 INFO:teuthology.orchestra.run.smithi062.stdout:(5/128): ceph-mgr-16.2.10-818.g9f1013ad.el8.x86 2.3 MB/s | 1.6 MB 00:00 2022-09-17T10:24:38.363 INFO:teuthology.orchestra.run.smithi062.stdout:(6/128): ceph-base-16.2.10-818.g9f1013ad.el8.x8 2.1 MB/s | 6.1 MB 00:02 2022-09-17T10:24:38.991 INFO:teuthology.orchestra.run.smithi093.stdout:(5/128): ceph-base-16.2.10-818.g9f1013ad.el8.x8 1.3 MB/s | 6.1 MB 00:04 2022-09-17T10:24:39.047 INFO:teuthology.orchestra.run.smithi093.stdout:(6/128): ceph-mgr-16.2.10-818.g9f1013ad.el8.x86 1.1 MB/s | 1.6 MB 00:01 2022-09-17T10:24:39.180 INFO:teuthology.orchestra.run.smithi159.stdout:(4/128): ceph-mds-16.2.10-818.g9f1013ad.el8.x86 845 kB/s | 2.4 MB 00:02 2022-09-17T10:24:40.035 INFO:teuthology.orchestra.run.smithi062.stdout:(7/128): ceph-mon-16.2.10-818.g9f1013ad.el8.x86 2.9 MB/s | 5.0 MB 00:01 2022-09-17T10:24:40.728 INFO:teuthology.orchestra.run.smithi159.stdout:(5/128): ceph-base-16.2.10-818.g9f1013ad.el8.x8 996 kB/s | 6.1 MB 00:06 2022-09-17T10:24:40.734 INFO:teuthology.orchestra.run.smithi159.stdout:(6/128): ceph-mgr-16.2.10-818.g9f1013ad.el8.x86 1.0 MB/s | 1.6 MB 00:01 2022-09-17T10:24:42.013 INFO:teuthology.orchestra.run.smithi093.stdout:(7/128): ceph-mon-16.2.10-818.g9f1013ad.el8.x86 1.6 MB/s | 5.0 MB 00:03 2022-09-17T10:24:42.656 INFO:teuthology.orchestra.run.smithi062.stdout:(8/128): ceph-common-16.2.10-818.g9f1013ad.el8. 3.4 MB/s | 24 MB 00:07 2022-09-17T10:24:42.687 INFO:teuthology.orchestra.run.smithi062.stdout:(9/128): ceph-selinux-16.2.10-818.g9f1013ad.el8 804 kB/s | 26 kB 00:00 2022-09-17T10:24:42.714 INFO:teuthology.orchestra.run.smithi093.stdout:(8/128): ceph-common-16.2.10-818.g9f1013ad.el8. 2.9 MB/s | 24 MB 00:08 2022-09-17T10:24:42.765 INFO:teuthology.orchestra.run.smithi093.stdout:(9/128): ceph-selinux-16.2.10-818.g9f1013ad.el8 502 kB/s | 26 kB 00:00 2022-09-17T10:24:43.181 INFO:teuthology.orchestra.run.smithi062.stdout:(10/128): ceph-radosgw-16.2.10-818.g9f1013ad.el 3.7 MB/s | 12 MB 00:03 2022-09-17T10:24:43.211 INFO:teuthology.orchestra.run.smithi159.stdout:(7/128): ceph-mon-16.2.10-818.g9f1013ad.el8.x86 2.0 MB/s | 5.0 MB 00:02 2022-09-17T10:24:43.286 INFO:teuthology.orchestra.run.smithi062.stdout:(11/128): cephfs-mirror-16.2.10-818.g9f1013ad.e 2.3 MB/s | 256 kB 00:00 2022-09-17T10:24:43.340 INFO:teuthology.orchestra.run.smithi062.stdout:(12/128): libcephfs-devel-16.2.10-818.g9f1013ad 469 kB/s | 25 kB 00:00 2022-09-17T10:24:43.569 INFO:teuthology.orchestra.run.smithi062.stdout:(13/128): libcephfs2-16.2.10-818.g9f1013ad.el8. 3.5 MB/s | 818 kB 00:00 2022-09-17T10:24:43.629 INFO:teuthology.orchestra.run.smithi062.stdout:(14/128): libcephsqlite-16.2.10-818.g9f1013ad.e 2.8 MB/s | 173 kB 00:00 2022-09-17T10:24:43.689 INFO:teuthology.orchestra.run.smithi062.stdout:(15/128): librados-devel-16.2.10-818.g9f1013ad. 2.2 MB/s | 131 kB 00:00 2022-09-17T10:24:43.879 INFO:teuthology.orchestra.run.smithi062.stdout:(16/128): libradosstriper1-16.2.10-818.g9f1013a 2.5 MB/s | 493 kB 00:00 2022-09-17T10:24:44.597 INFO:teuthology.orchestra.run.smithi062.stdout:(17/128): ceph-osd-16.2.10-818.g9f1013ad.el8.x8 2.9 MB/s | 18 MB 00:06 2022-09-17T10:24:44.657 INFO:teuthology.orchestra.run.smithi062.stdout:(18/128): python3-ceph-argparse-16.2.10-818.g9f 725 kB/s | 45 kB 00:00 2022-09-17T10:24:44.717 INFO:teuthology.orchestra.run.smithi062.stdout:(19/128): python3-ceph-common-16.2.10-818.g9f10 1.6 MB/s | 96 kB 00:00 2022-09-17T10:24:44.781 INFO:teuthology.orchestra.run.smithi062.stdout:(20/128): python3-cephfs-16.2.10-818.g9f1013ad. 3.3 MB/s | 216 kB 00:00 2022-09-17T10:24:44.913 INFO:teuthology.orchestra.run.smithi062.stdout:(21/128): python3-rados-16.2.10-818.g9f1013ad.e 3.0 MB/s | 387 kB 00:00 2022-09-17T10:24:45.040 INFO:teuthology.orchestra.run.smithi062.stdout:(22/128): python3-rbd-16.2.10-818.g9f1013ad.el8 2.8 MB/s | 368 kB 00:00 2022-09-17T10:24:45.090 INFO:teuthology.orchestra.run.smithi062.stdout:(23/128): librgw2-16.2.10-818.g9f1013ad.el8.x86 3.1 MB/s | 3.8 MB 00:01 2022-09-17T10:24:45.092 INFO:teuthology.orchestra.run.smithi062.stdout:(24/128): python3-rgw-16.2.10-818.g9f1013ad.el8 2.0 MB/s | 114 kB 00:00 2022-09-17T10:24:45.149 INFO:teuthology.orchestra.run.smithi062.stdout:(25/128): rbd-fuse-16.2.10-818.g9f1013ad.el8.x8 1.6 MB/s | 88 kB 00:00 2022-09-17T10:24:45.209 INFO:teuthology.orchestra.run.smithi062.stdout:(26/128): rbd-nbd-16.2.10-818.g9f1013ad.el8.x86 2.6 MB/s | 173 kB 00:00 2022-09-17T10:24:45.268 INFO:teuthology.orchestra.run.smithi062.stdout:(27/128): ceph-grafana-dashboards-16.2.10-818.g 412 kB/s | 24 kB 00:00 2022-09-17T10:24:45.331 INFO:teuthology.orchestra.run.smithi062.stdout:(28/128): ceph-mgr-cephadm-16.2.10-818.g9f1013a 1.8 MB/s | 113 kB 00:00 2022-09-17T10:24:46.149 INFO:teuthology.orchestra.run.smithi062.stdout:(29/128): rbd-mirror-16.2.10-818.g9f1013ad.el8. 3.5 MB/s | 3.7 MB 00:01 2022-09-17T10:24:46.159 INFO:teuthology.orchestra.run.smithi062.stdout:(30/128): ceph-mgr-dashboard-16.2.10-818.g9f101 3.7 MB/s | 3.1 MB 00:00 2022-09-17T10:24:46.223 INFO:teuthology.orchestra.run.smithi062.stdout:(31/128): ceph-mgr-modules-core-16.2.10-818.g9f 3.8 MB/s | 241 kB 00:00 2022-09-17T10:24:46.275 INFO:teuthology.orchestra.run.smithi062.stdout:(32/128): ceph-mgr-rook-16.2.10-818.g9f1013ad.e 509 kB/s | 27 kB 00:00 2022-09-17T10:24:46.329 INFO:teuthology.orchestra.run.smithi062.stdout:(33/128): ceph-prometheus-alerts-16.2.10-818.g9 282 kB/s | 15 kB 00:00 2022-09-17T10:24:46.384 INFO:teuthology.orchestra.run.smithi062.stdout:(34/128): cephadm-16.2.10-818.g9f1013ad.el8.noa 1.4 MB/s | 82 kB 00:00 2022-09-17T10:24:46.438 INFO:teuthology.orchestra.run.smithi062.stdout:(35/128): cephfs-top-16.2.10-818.g9f1013ad.el8. 271 kB/s | 14 kB 00:00 2022-09-17T10:24:46.603 INFO:teuthology.orchestra.run.smithi062.stdout:(36/128): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2022-09-17T10:24:46.632 INFO:teuthology.orchestra.run.smithi062.stdout:(37/128): leveldb-1.22-1.el8.x86_64.rpm 6.0 MB/s | 181 kB 00:00 2022-09-17T10:24:46.660 INFO:teuthology.orchestra.run.smithi062.stdout:(38/128): liboath-2.6.2-3.el8.x86_64.rpm 2.1 MB/s | 59 kB 00:00 2022-09-17T10:24:46.688 INFO:teuthology.orchestra.run.smithi062.stdout:(39/128): libunwind-1.3.1-3.el8.x86_64.rpm 2.6 MB/s | 75 kB 00:00 2022-09-17T10:24:46.698 INFO:teuthology.orchestra.run.smithi093.stdout:(10/128): ceph-radosgw-16.2.10-818.g9f1013ad.el 2.5 MB/s | 12 MB 00:04 2022-09-17T10:24:46.715 INFO:teuthology.orchestra.run.smithi062.stdout:(40/128): python3-apipkg-1.5-6.el8.noarch.rpm 779 kB/s | 21 kB 00:00 2022-09-17T10:24:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:(41/128): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.5 MB/s | 44 kB 00:00 2022-09-17T10:24:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:(42/128): python3-beautifulsoup4-4.6.3-2.el8.1. 6.2 MB/s | 185 kB 00:00 2022-09-17T10:24:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:(43/128): python3-cachetools-3.1.1-4.el8.noarch 1.2 MB/s | 33 kB 00:00 2022-09-17T10:24:46.802 INFO:teuthology.orchestra.run.smithi093.stdout:(11/128): cephfs-mirror-16.2.10-818.g9f1013ad.e 2.4 MB/s | 256 kB 00:00 2022-09-17T10:24:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:(44/128): python3-certifi-2018.10.15-7.el8.noar 599 kB/s | 16 kB 00:00 2022-09-17T10:24:46.851 INFO:teuthology.orchestra.run.smithi093.stdout:(12/128): libcephfs-devel-16.2.10-818.g9f1013ad 515 kB/s | 25 kB 00:00 2022-09-17T10:24:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:(45/128): python3-cheroot-8.5.2-1.el8.noarch.rp 5.8 MB/s | 173 kB 00:00 2022-09-17T10:24:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:(46/128): python3-cherrypy-18.4.0-1.el8.noarch. 6.8 MB/s | 384 kB 00:00 2022-09-17T10:24:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:(47/128): python3-execnet-1.7.1-1.el8.noarch.rp 6.3 MB/s | 355 kB 00:00 2022-09-17T10:24:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:(48/128): python3-google-auth-1.1.1-10.el8.noar 2.8 MB/s | 81 kB 00:00 2022-09-17T10:24:47.024 INFO:teuthology.orchestra.run.smithi062.stdout:(49/128): python3-jaraco-6.2-6.el8.noarch.rpm 409 kB/s | 11 kB 00:00 2022-09-17T10:24:47.051 INFO:teuthology.orchestra.run.smithi062.stdout:(50/128): python3-jaraco-functools-2.0-4.el8.no 645 kB/s | 18 kB 00:00 2022-09-17T10:24:47.121 INFO:teuthology.orchestra.run.smithi093.stdout:(13/128): libcephfs2-16.2.10-818.g9f1013ad.el8. 3.0 MB/s | 818 kB 00:00 2022-09-17T10:24:47.164 INFO:teuthology.orchestra.run.smithi062.stdout:(51/128): python3-kubernetes-11.0.0-6.el8.noarc 10 MB/s | 1.2 MB 00:00 2022-09-17T10:24:47.176 INFO:teuthology.orchestra.run.smithi093.stdout:(14/128): libcephsqlite-16.2.10-818.g9f1013ad.e 3.1 MB/s | 173 kB 00:00 2022-09-17T10:24:47.192 INFO:teuthology.orchestra.run.smithi062.stdout:(52/128): python3-logutils-0.3.5-11.el8.noarch. 1.7 MB/s | 49 kB 00:00 2022-09-17T10:24:47.220 INFO:teuthology.orchestra.run.smithi062.stdout:(53/128): python3-more-itertools-7.2.0-3.el8.no 2.1 MB/s | 59 kB 00:00 2022-09-17T10:24:47.230 INFO:teuthology.orchestra.run.smithi093.stdout:(15/128): librados-devel-16.2.10-818.g9f1013ad. 2.4 MB/s | 131 kB 00:00 2022-09-17T10:24:47.251 INFO:teuthology.orchestra.run.smithi062.stdout:(54/128): python3-pecan-1.3.2-9.el8.noarch.rpm 9.1 MB/s | 283 kB 00:00 2022-09-17T10:24:47.279 INFO:teuthology.orchestra.run.smithi062.stdout:(55/128): python3-portend-2.6-1.el8.noarch.rpm 571 kB/s | 16 kB 00:00 2022-09-17T10:24:47.306 INFO:teuthology.orchestra.run.smithi062.stdout:(56/128): python3-remoto-1.2.1-1.el8.noarch.rpm 1.7 MB/s | 49 kB 00:00 2022-09-17T10:24:47.334 INFO:teuthology.orchestra.run.smithi062.stdout:(57/128): python3-repoze-lru-0.7-6.el8.noarch.r 1.2 MB/s | 34 kB 00:00 2022-09-17T10:24:47.363 INFO:teuthology.orchestra.run.smithi062.stdout:(58/128): python3-routes-2.4.1-12.el8.noarch.rp 6.5 MB/s | 196 kB 00:00 2022-09-17T10:24:47.391 INFO:teuthology.orchestra.run.smithi062.stdout:(59/128): python3-rsa-4.8-1.el8.noarch.rpm 2.2 MB/s | 61 kB 00:00 2022-09-17T10:24:47.394 INFO:teuthology.orchestra.run.smithi093.stdout:(16/128): libradosstriper1-16.2.10-818.g9f1013a 2.9 MB/s | 493 kB 00:00 2022-09-17T10:24:47.423 INFO:teuthology.orchestra.run.smithi062.stdout:(60/128): python3-simplegeneric-0.8.1-17.el8.no 673 kB/s | 19 kB 00:00 2022-09-17T10:24:47.447 INFO:teuthology.orchestra.run.smithi062.stdout:(61/128): python3-singledispatch-3.4.0.3-18.el8 865 kB/s | 24 kB 00:00 2022-09-17T10:24:47.475 INFO:teuthology.orchestra.run.smithi062.stdout:(62/128): python3-tempora-1.14.1-5.el8.noarch.r 1.0 MB/s | 29 kB 00:00 2022-09-17T10:24:47.502 INFO:teuthology.orchestra.run.smithi062.stdout:(63/128): python3-trustme-0.6.0-4.el8.noarch.rp 1.0 MB/s | 27 kB 00:00 2022-09-17T10:24:47.532 INFO:teuthology.orchestra.run.smithi062.stdout:(64/128): python3-waitress-1.2.1-2.el8.1.noarch 7.9 MB/s | 241 kB 00:00 2022-09-17T10:24:47.562 INFO:teuthology.orchestra.run.smithi062.stdout:(65/128): python3-webob-1.8.5-1.el8.1.noarch.rp 8.2 MB/s | 251 kB 00:00 2022-09-17T10:24:47.591 INFO:teuthology.orchestra.run.smithi062.stdout:(66/128): python3-websocket-client-0.56.0-5.el8 2.1 MB/s | 61 kB 00:00 2022-09-17T10:24:47.619 INFO:teuthology.orchestra.run.smithi062.stdout:(67/128): python3-webtest-2.0.33-1.el8.noarch.r 3.0 MB/s | 85 kB 00:00 2022-09-17T10:24:47.650 INFO:teuthology.orchestra.run.smithi062.stdout:(68/128): python3-zc-lockfile-2.0-2.el8.noarch. 833 kB/s | 23 kB 00:00 2022-09-17T10:24:47.653 INFO:teuthology.orchestra.run.smithi062.stdout:(69/128): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2022-09-17T10:24:47.703 INFO:teuthology.orchestra.run.smithi062.stdout:(70/128): openblas-0.3.12-1.el8.x86_64.rpm 89 MB/s | 4.6 MB 00:00 2022-09-17T10:24:47.718 INFO:teuthology.orchestra.run.smithi062.stdout:(71/128): socat-1.7.3.3-2.el8.x86_64.rpm 20 MB/s | 302 kB 00:00 2022-09-17T10:24:47.735 INFO:teuthology.orchestra.run.smithi062.stdout:(72/128): bison-3.0.4-10.el8.x86_64.rpm 38 MB/s | 688 kB 00:00 2022-09-17T10:24:47.748 INFO:teuthology.orchestra.run.smithi062.stdout:(73/128): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2022-09-17T10:24:47.762 INFO:teuthology.orchestra.run.smithi062.stdout:(74/128): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2022-09-17T10:24:47.778 INFO:teuthology.orchestra.run.smithi062.stdout:(75/128): python3-werkzeug-0.12.2-4.el8.noarch. 28 MB/s | 457 kB 00:00 2022-09-17T10:24:47.793 INFO:teuthology.orchestra.run.smithi062.stdout:(76/128): python3-numpy-f2py-1.14.3-9.el8.x86_6 15 MB/s | 225 kB 00:00 2022-09-17T10:24:47.806 INFO:teuthology.orchestra.run.smithi062.stdout:(77/128): oniguruma-6.8.2-2.el8.x86_64.rpm 14 MB/s | 187 kB 00:00 2022-09-17T10:24:47.852 INFO:teuthology.orchestra.run.smithi062.stdout:(78/128): openblas-threads-0.3.12-1.el8.x86_64. 104 MB/s | 4.7 MB 00:00 2022-09-17T10:24:47.871 INFO:teuthology.orchestra.run.smithi062.stdout:(79/128): libtool-2.4.6-25.el8.x86_64.rpm 36 MB/s | 709 kB 00:00 2022-09-17T10:24:47.891 INFO:teuthology.orchestra.run.smithi062.stdout:(80/128): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2022-09-17T10:24:47.906 INFO:teuthology.orchestra.run.smithi093.stdout:(17/128): ceph-osd-16.2.10-818.g9f1013ad.el8.x8 2.1 MB/s | 18 MB 00:08 2022-09-17T10:24:47.907 INFO:teuthology.orchestra.run.smithi062.stdout:(81/128): python3-pyOpenSSL-19.0.0-1.el8.noarch 7.4 MB/s | 103 kB 00:00 2022-09-17T10:24:47.939 INFO:teuthology.orchestra.run.smithi062.stdout:(82/128): python3-numpy-1.14.3-9.el8.x86_64.rpm 96 MB/s | 3.7 MB 00:00 2022-09-17T10:24:47.963 INFO:teuthology.orchestra.run.smithi093.stdout:(18/128): python3-ceph-argparse-16.2.10-818.g9f 814 kB/s | 45 kB 00:00 2022-09-17T10:24:47.963 INFO:teuthology.orchestra.run.smithi062.stdout:(83/128): librdkafka-0.11.4-1.el8.x86_64.rpm 22 MB/s | 353 kB 00:00 2022-09-17T10:24:47.969 INFO:teuthology.orchestra.run.smithi062.stdout:(84/128): flex-2.6.1-9.el8.x86_64.rpm 21 MB/s | 320 kB 00:00 2022-09-17T10:24:48.017 INFO:teuthology.orchestra.run.smithi093.stdout:(19/128): python3-ceph-common-16.2.10-818.g9f10 1.6 MB/s | 96 kB 00:00 2022-09-17T10:24:48.122 INFO:teuthology.orchestra.run.smithi093.stdout:(20/128): python3-cephfs-16.2.10-818.g9f1013ad. 2.0 MB/s | 216 kB 00:00 2022-09-17T10:24:48.148 INFO:teuthology.orchestra.run.smithi062.stdout:(85/128): python3-scipy-1.0.0-20.module+el8.1.0 81 MB/s | 15 MB 00:00 2022-09-17T10:24:48.173 INFO:teuthology.orchestra.run.smithi062.stdout:(86/128): ceph-mgr-diskprediction-local-16.2.10 4.2 MB/s | 8.6 MB 00:02 2022-09-17T10:24:48.189 INFO:teuthology.orchestra.run.smithi062.stdout:(87/128): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2022-09-17T10:24:48.200 INFO:teuthology.orchestra.run.smithi062.stdout:(88/128): python3-jinja2-2.10.1-2.el8_0.noarch. 19 MB/s | 538 kB 00:00 2022-09-17T10:24:48.201 INFO:teuthology.orchestra.run.smithi062.stdout:(89/128): python3-jsonpointer-1.10-11.el8.noarc 1.6 MB/s | 20 kB 00:00 2022-09-17T10:24:48.215 INFO:teuthology.orchestra.run.smithi062.stdout:(90/128): lttng-ust-2.8.1-11.el8.x86_64.rpm 17 MB/s | 259 kB 00:00 2022-09-17T10:24:48.217 INFO:teuthology.orchestra.run.smithi062.stdout:(91/128): python3-pyasn1-0.3.7-6.el8.noarch.rpm 8.2 MB/s | 126 kB 00:00 2022-09-17T10:24:48.232 INFO:teuthology.orchestra.run.smithi062.stdout:(92/128): python3-jsonpatch-1.21-2.el8.noarch.r 1.8 MB/s | 27 kB 00:00 2022-09-17T10:24:48.247 INFO:teuthology.orchestra.run.smithi062.stdout:(93/128): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2022-09-17T10:24:48.265 INFO:teuthology.orchestra.run.smithi093.stdout:(21/128): python3-rados-16.2.10-818.g9f1013ad.e 2.6 MB/s | 387 kB 00:00 2022-09-17T10:24:48.307 INFO:teuthology.orchestra.run.smithi159.stdout:(8/128): ceph-radosgw-16.2.10-818.g9f1013ad.el8 2.3 MB/s | 12 MB 00:05 2022-09-17T10:24:48.356 INFO:teuthology.orchestra.run.smithi159.stdout:(9/128): ceph-selinux-16.2.10-818.g9f1013ad.el8 521 kB/s | 26 kB 00:00 2022-09-17T10:24:48.372 INFO:teuthology.orchestra.run.smithi062.stdout:(94/128): python3-babel-2.5.1-5.el8.noarch.rpm 31 MB/s | 4.8 MB 00:00 2022-09-17T10:24:48.385 INFO:teuthology.orchestra.run.smithi062.stdout:(95/128): automake-1.16.1-7.el8.noarch.rpm 5.1 MB/s | 713 kB 00:00 2022-09-17T10:24:48.387 INFO:teuthology.orchestra.run.smithi062.stdout:(96/128): python3-pyasn1-modules-0.3.7-6.el8.no 8.2 MB/s | 110 kB 00:00 2022-09-17T10:24:48.403 INFO:teuthology.orchestra.run.smithi062.stdout:(97/128): pcre2-utf32-10.32-2.el8.x86_64.rpm 14 MB/s | 220 kB 00:00 2022-09-17T10:24:48.405 INFO:teuthology.orchestra.run.smithi062.stdout:(98/128): pcre2-devel-10.32-2.el8.x86_64.rpm 30 MB/s | 605 kB 00:00 2022-09-17T10:24:48.406 INFO:teuthology.orchestra.run.smithi093.stdout:(22/128): python3-rbd-16.2.10-818.g9f1013ad.el8 2.5 MB/s | 368 kB 00:00 2022-09-17T10:24:48.421 INFO:teuthology.orchestra.run.smithi093.stdout:(23/128): librgw2-16.2.10-818.g9f1013ad.el8.x86 3.7 MB/s | 3.8 MB 00:01 2022-09-17T10:24:48.426 INFO:teuthology.orchestra.run.smithi062.stdout:(99/128): python3-cryptography-3.2.1-4.el8.x86_ 29 MB/s | 559 kB 00:00 2022-09-17T10:24:48.437 INFO:teuthology.orchestra.run.smithi062.stdout:(100/128): openssl-devel-1.1.1g-15.el8_3.x86_64 68 MB/s | 2.3 MB 00:00 2022-09-17T10:24:48.446 INFO:teuthology.orchestra.run.smithi062.stdout:(101/128): libcom_err-devel-1.45.6-1.el8.x86_64 1.9 MB/s | 38 kB 00:00 2022-09-17T10:24:48.453 INFO:teuthology.orchestra.run.smithi062.stdout:(102/128): keyutils-libs-devel-1.5.10-6.el8.x86 3.8 MB/s | 48 kB 00:00 2022-09-17T10:24:48.455 INFO:teuthology.orchestra.run.smithi093.stdout:(24/128): python3-rgw-16.2.10-818.g9f1013ad.el8 2.3 MB/s | 114 kB 00:00 2022-09-17T10:24:48.460 INFO:teuthology.orchestra.run.smithi062.stdout:(103/128): libselinux-devel-2.9-5.el8.x86_64.rp 14 MB/s | 200 kB 00:00 2022-09-17T10:24:48.463 INFO:teuthology.orchestra.run.smithi062.stdout:(104/128): libverto-devel-0.3.0-5.el8.x86_64.rp 1.4 MB/s | 18 kB 00:00 2022-09-17T10:24:48.482 INFO:teuthology.orchestra.run.smithi093.stdout:(25/128): rbd-fuse-16.2.10-818.g9f1013ad.el8.x8 1.8 MB/s | 88 kB 00:00 2022-09-17T10:24:48.483 INFO:teuthology.orchestra.run.smithi062.stdout:(105/128): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.8 MB/s | 47 kB 00:00 2022-09-17T10:24:48.483 INFO:teuthology.orchestra.run.smithi062.stdout:(106/128): fuse-2.9.7-12.el8.x86_64.rpm 6.0 MB/s | 83 kB 00:00 2022-09-17T10:24:48.492 INFO:teuthology.orchestra.run.smithi062.stdout:(107/128): python3-oauthlib-2.1.0-1.el8.noarch. 11 MB/s | 155 kB 00:00 2022-09-17T10:24:48.492 INFO:teuthology.orchestra.run.smithi062.stdout:(108/128): python3-pycparser-2.14-14.el8.noarch 7.7 MB/s | 109 kB 00:00 2022-09-17T10:24:48.499 INFO:teuthology.orchestra.run.smithi062.stdout:(109/128): elfutils-libelf-devel-0.182-3.el8.x8 4.4 MB/s | 59 kB 00:00 2022-09-17T10:24:48.508 INFO:teuthology.orchestra.run.smithi062.stdout:(110/128): python3-jwt-1.6.1-2.el8.noarch.rpm 3.2 MB/s | 43 kB 00:00 2022-09-17T10:24:48.514 INFO:teuthology.orchestra.run.smithi062.stdout:(111/128): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.0 MB/s | 70 kB 00:00 2022-09-17T10:24:48.518 INFO:teuthology.orchestra.run.smithi062.stdout:(112/128): libaio-devel-0.3.112-1.el8.x86_64.rp 1.4 MB/s | 19 kB 00:00 2022-09-17T10:24:48.522 INFO:teuthology.orchestra.run.smithi093.stdout:(26/128): rbd-nbd-16.2.10-818.g9f1013ad.el8.x86 3.2 MB/s | 173 kB 00:00 2022-09-17T10:24:48.535 INFO:teuthology.orchestra.run.smithi062.stdout:(113/128): python3-cffi-1.11.5-5.el8.x86_64.rpm 17 MB/s | 238 kB 00:00 2022-09-17T10:24:48.535 INFO:teuthology.orchestra.run.smithi062.stdout:(114/128): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 27 MB/s | 559 kB 00:00 2022-09-17T10:24:48.548 INFO:teuthology.orchestra.run.smithi062.stdout:(115/128): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2022-09-17T10:24:48.549 INFO:teuthology.orchestra.run.smithi062.stdout:(116/128): python3-requests-oauthlib-1.0.0-1.el 3.1 MB/s | 43 kB 00:00 2022-09-17T10:24:48.561 INFO:teuthology.orchestra.run.smithi062.stdout:(117/128): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2022-09-17T10:24:48.561 INFO:teuthology.orchestra.run.smithi062.stdout:(118/128): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2022-09-17T10:24:48.569 INFO:teuthology.orchestra.run.smithi093.stdout:(27/128): ceph-grafana-dashboards-16.2.10-818.g 508 kB/s | 24 kB 00:00 2022-09-17T10:24:48.574 INFO:teuthology.orchestra.run.smithi062.stdout:(119/128): libuuid-devel-2.32.1-27.el8.x86_64.r 7.2 MB/s | 97 kB 00:00 2022-09-17T10:24:48.575 INFO:teuthology.orchestra.run.smithi062.stdout:(120/128): libsepol-devel-2.9-2.el8.x86_64.rpm 6.3 MB/s | 86 kB 00:00 2022-09-17T10:24:48.591 INFO:teuthology.orchestra.run.smithi062.stdout:(121/128): libgfortran-8.4.1-1.el8.x86_64.rpm 38 MB/s | 639 kB 00:00 2022-09-17T10:24:48.621 INFO:teuthology.orchestra.run.smithi093.stdout:(28/128): ceph-mgr-cephadm-16.2.10-818.g9f1013a 2.2 MB/s | 113 kB 00:00 2022-09-17T10:24:48.820 INFO:teuthology.orchestra.run.smithi159.stdout:(10/128): ceph-osd-16.2.10-818.g9f1013ad.el8.x8 2.3 MB/s | 18 MB 00:08 2022-09-17T10:24:48.959 INFO:teuthology.orchestra.run.smithi159.stdout:(11/128): cephfs-mirror-16.2.10-818.g9f1013ad.e 1.8 MB/s | 256 kB 00:00 2022-09-17T10:24:49.026 INFO:teuthology.orchestra.run.smithi159.stdout:(12/128): libcephfs-devel-16.2.10-818.g9f1013ad 374 kB/s | 25 kB 00:00 2022-09-17T10:24:49.328 INFO:teuthology.orchestra.run.smithi159.stdout:(13/128): libcephfs2-16.2.10-818.g9f1013ad.el8. 2.6 MB/s | 818 kB 00:00 2022-09-17T10:24:49.405 INFO:teuthology.orchestra.run.smithi159.stdout:(14/128): libcephsqlite-16.2.10-818.g9f1013ad.e 2.2 MB/s | 173 kB 00:00 2022-09-17T10:24:49.477 INFO:teuthology.orchestra.run.smithi159.stdout:(15/128): librados-devel-16.2.10-818.g9f1013ad. 1.8 MB/s | 131 kB 00:00 2022-09-17T10:24:49.479 INFO:teuthology.orchestra.run.smithi093.stdout:(29/128): ceph-mgr-dashboard-16.2.10-818.g9f101 3.6 MB/s | 3.1 MB 00:00 2022-09-17T10:24:49.627 INFO:teuthology.orchestra.run.smithi159.stdout:(16/128): libradosstriper1-16.2.10-818.g9f1013a 3.2 MB/s | 493 kB 00:00 2022-09-17T10:24:49.836 INFO:teuthology.orchestra.run.smithi062.stdout:(122/128): librbd1-16.2.10-818.g9f1013ad.el8.x8 3.3 MB/s | 4.2 MB 00:01 2022-09-17T10:24:49.852 INFO:teuthology.orchestra.run.smithi062.stdout:(123/128): NetworkManager-tui-1.30.0-13.el8_4.x 21 MB/s | 329 kB 00:00 2022-09-17T10:24:49.883 INFO:teuthology.orchestra.run.smithi062.stdout:(124/128): NetworkManager-1.30.0-13.el8_4.x86_6 82 MB/s | 2.6 MB 00:00 2022-09-17T10:24:49.898 INFO:teuthology.orchestra.run.smithi062.stdout:(125/128): NetworkManager-team-1.30.0-13.el8_4. 10 MB/s | 146 kB 00:00 2022-09-17T10:24:49.916 INFO:teuthology.orchestra.run.smithi062.stdout:(126/128): librados2-16.2.10-818.g9f1013ad.el8. 2.8 MB/s | 3.7 MB 00:01 2022-09-17T10:24:49.928 INFO:teuthology.orchestra.run.smithi062.stdout:(127/128): NetworkManager-libnm-1.30.0-13.el8_4 62 MB/s | 1.8 MB 00:00 2022-09-17T10:24:50.007 INFO:teuthology.orchestra.run.smithi093.stdout:(30/128): rbd-mirror-16.2.10-818.g9f1013ad.el8. 2.4 MB/s | 3.7 MB 00:01 2022-09-17T10:24:50.119 INFO:teuthology.orchestra.run.smithi093.stdout:(31/128): ceph-mgr-modules-core-16.2.10-818.g9f 2.1 MB/s | 241 kB 00:00 2022-09-17T10:24:50.160 INFO:teuthology.orchestra.run.smithi093.stdout:(32/128): ceph-mgr-rook-16.2.10-818.g9f1013ad.e 673 kB/s | 27 kB 00:00 2022-09-17T10:24:50.210 INFO:teuthology.orchestra.run.smithi093.stdout:(33/128): ceph-prometheus-alerts-16.2.10-818.g9 301 kB/s | 15 kB 00:00 2022-09-17T10:24:50.250 INFO:teuthology.orchestra.run.smithi093.stdout:(34/128): cephadm-16.2.10-818.g9f1013ad.el8.noa 2.0 MB/s | 82 kB 00:00 2022-09-17T10:24:50.291 INFO:teuthology.orchestra.run.smithi093.stdout:(35/128): cephfs-top-16.2.10-818.g9f1013ad.el8. 353 kB/s | 14 kB 00:00 2022-09-17T10:24:50.460 INFO:teuthology.orchestra.run.smithi093.stdout:(36/128): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2022-09-17T10:24:50.490 INFO:teuthology.orchestra.run.smithi093.stdout:(37/128): leveldb-1.22-1.el8.x86_64.rpm 5.9 MB/s | 181 kB 00:00 2022-09-17T10:24:50.519 INFO:teuthology.orchestra.run.smithi093.stdout:(38/128): liboath-2.6.2-3.el8.x86_64.rpm 2.0 MB/s | 59 kB 00:00 2022-09-17T10:24:50.548 INFO:teuthology.orchestra.run.smithi093.stdout:(39/128): libunwind-1.3.1-3.el8.x86_64.rpm 2.6 MB/s | 75 kB 00:00 2022-09-17T10:24:50.576 INFO:teuthology.orchestra.run.smithi093.stdout:(40/128): python3-apipkg-1.5-6.el8.noarch.rpm 754 kB/s | 21 kB 00:00 2022-09-17T10:24:50.604 INFO:teuthology.orchestra.run.smithi093.stdout:(41/128): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.5 MB/s | 44 kB 00:00 2022-09-17T10:24:50.635 INFO:teuthology.orchestra.run.smithi093.stdout:(42/128): python3-beautifulsoup4-4.6.3-2.el8.1. 6.0 MB/s | 185 kB 00:00 2022-09-17T10:24:50.642 INFO:teuthology.orchestra.run.smithi159.stdout:(17/128): ceph-common-16.2.10-818.g9f1013ad.el8 1.5 MB/s | 24 MB 00:16 2022-09-17T10:24:50.664 INFO:teuthology.orchestra.run.smithi093.stdout:(43/128): python3-cachetools-3.1.1-4.el8.noarch 1.1 MB/s | 33 kB 00:00 2022-09-17T10:24:50.693 INFO:teuthology.orchestra.run.smithi093.stdout:(44/128): python3-certifi-2018.10.15-7.el8.noar 580 kB/s | 16 kB 00:00 2022-09-17T10:24:50.723 INFO:teuthology.orchestra.run.smithi093.stdout:(45/128): python3-cheroot-8.5.2-1.el8.noarch.rp 5.7 MB/s | 173 kB 00:00 2022-09-17T10:24:50.726 INFO:teuthology.orchestra.run.smithi159.stdout:(18/128): librgw2-16.2.10-818.g9f1013ad.el8.x86 3.4 MB/s | 3.8 MB 00:01 2022-09-17T10:24:50.727 INFO:teuthology.orchestra.run.smithi159.stdout:(19/128): python3-ceph-argparse-16.2.10-818.g9f 526 kB/s | 45 kB 00:00 2022-09-17T10:24:50.768 INFO:teuthology.orchestra.run.smithi159.stdout:(20/128): python3-ceph-common-16.2.10-818.g9f10 2.3 MB/s | 96 kB 00:00 2022-09-17T10:24:50.780 INFO:teuthology.orchestra.run.smithi093.stdout:(46/128): python3-cherrypy-18.4.0-1.el8.noarch. 6.6 MB/s | 384 kB 00:00 2022-09-17T10:24:50.822 INFO:teuthology.orchestra.run.smithi159.stdout:(21/128): python3-cephfs-16.2.10-818.g9f1013ad. 2.2 MB/s | 216 kB 00:00 2022-09-17T10:24:50.837 INFO:teuthology.orchestra.run.smithi093.stdout:(47/128): python3-execnet-1.7.1-1.el8.noarch.rp 6.1 MB/s | 355 kB 00:00 2022-09-17T10:24:50.865 INFO:teuthology.orchestra.run.smithi159.stdout:(22/128): python3-rados-16.2.10-818.g9f1013ad.e 3.9 MB/s | 387 kB 00:00 2022-09-17T10:24:50.866 INFO:teuthology.orchestra.run.smithi093.stdout:(48/128): python3-google-auth-1.1.1-10.el8.noar 2.8 MB/s | 81 kB 00:00 2022-09-17T10:24:50.896 INFO:teuthology.orchestra.run.smithi093.stdout:(49/128): python3-jaraco-6.2-6.el8.noarch.rpm 396 kB/s | 11 kB 00:00 2022-09-17T10:24:50.913 INFO:teuthology.orchestra.run.smithi159.stdout:(23/128): python3-rgw-16.2.10-818.g9f1013ad.el8 2.3 MB/s | 114 kB 00:00 2022-09-17T10:24:50.923 INFO:teuthology.orchestra.run.smithi093.stdout:(50/128): python3-jaraco-functools-2.0-4.el8.no 627 kB/s | 18 kB 00:00 2022-09-17T10:24:50.959 INFO:teuthology.orchestra.run.smithi159.stdout:(24/128): rbd-fuse-16.2.10-818.g9f1013ad.el8.x8 1.8 MB/s | 88 kB 00:00 2022-09-17T10:24:50.961 INFO:teuthology.orchestra.run.smithi159.stdout:(25/128): python3-rbd-16.2.10-818.g9f1013ad.el8 2.6 MB/s | 368 kB 00:00 2022-09-17T10:24:51.039 INFO:teuthology.orchestra.run.smithi093.stdout:(51/128): python3-kubernetes-11.0.0-6.el8.noarc 10 MB/s | 1.2 MB 00:00 2022-09-17T10:24:51.060 INFO:teuthology.orchestra.run.smithi159.stdout:(26/128): rbd-nbd-16.2.10-818.g9f1013ad.el8.x86 1.7 MB/s | 173 kB 00:00 2022-09-17T10:24:51.068 INFO:teuthology.orchestra.run.smithi093.stdout:(52/128): python3-logutils-0.3.5-11.el8.noarch. 1.7 MB/s | 49 kB 00:00 2022-09-17T10:24:51.097 INFO:teuthology.orchestra.run.smithi093.stdout:(53/128): python3-more-itertools-7.2.0-3.el8.no 2.0 MB/s | 59 kB 00:00 2022-09-17T10:24:51.108 INFO:teuthology.orchestra.run.smithi159.stdout:(27/128): ceph-grafana-dashboards-16.2.10-818.g 507 kB/s | 24 kB 00:00 2022-09-17T10:24:51.129 INFO:teuthology.orchestra.run.smithi093.stdout:(54/128): python3-pecan-1.3.2-9.el8.noarch.rpm 8.9 MB/s | 283 kB 00:00 2022-09-17T10:24:51.157 INFO:teuthology.orchestra.run.smithi093.stdout:(55/128): python3-portend-2.6-1.el8.noarch.rpm 555 kB/s | 16 kB 00:00 2022-09-17T10:24:51.158 INFO:teuthology.orchestra.run.smithi159.stdout:(28/128): ceph-mgr-cephadm-16.2.10-818.g9f1013a 2.2 MB/s | 113 kB 00:00 2022-09-17T10:24:51.185 INFO:teuthology.orchestra.run.smithi093.stdout:(56/128): python3-remoto-1.2.1-1.el8.noarch.rpm 1.7 MB/s | 49 kB 00:00 2022-09-17T10:24:51.213 INFO:teuthology.orchestra.run.smithi093.stdout:(57/128): python3-repoze-lru-0.7-6.el8.noarch.r 1.2 MB/s | 34 kB 00:00 2022-09-17T10:24:51.244 INFO:teuthology.orchestra.run.smithi093.stdout:(58/128): python3-routes-2.4.1-12.el8.noarch.rp 6.4 MB/s | 196 kB 00:00 2022-09-17T10:24:51.273 INFO:teuthology.orchestra.run.smithi093.stdout:(59/128): python3-rsa-4.8-1.el8.noarch.rpm 2.1 MB/s | 61 kB 00:00 2022-09-17T10:24:51.306 INFO:teuthology.orchestra.run.smithi093.stdout:(60/128): ceph-mgr-diskprediction-local-16.2.10 4.7 MB/s | 8.6 MB 00:01 2022-09-17T10:24:51.306 INFO:teuthology.orchestra.run.smithi093.stdout:(61/128): python3-simplegeneric-0.8.1-17.el8.no 559 kB/s | 19 kB 00:00 2022-09-17T10:24:51.335 INFO:teuthology.orchestra.run.smithi093.stdout:(62/128): python3-tempora-1.14.1-5.el8.noarch.r 1.0 MB/s | 29 kB 00:00 2022-09-17T10:24:51.363 INFO:teuthology.orchestra.run.smithi093.stdout:(63/128): python3-trustme-0.6.0-4.el8.noarch.rp 973 kB/s | 27 kB 00:00 2022-09-17T10:24:51.387 INFO:teuthology.orchestra.run.smithi093.stdout:(64/128): python3-singledispatch-3.4.0.3-18.el8 294 kB/s | 24 kB 00:00 2022-09-17T10:24:51.394 INFO:teuthology.orchestra.run.smithi093.stdout:(65/128): python3-waitress-1.2.1-2.el8.1.noarch 7.6 MB/s | 241 kB 00:00 2022-09-17T10:24:51.423 INFO:teuthology.orchestra.run.smithi093.stdout:(66/128): python3-websocket-client-0.56.0-5.el8 2.1 MB/s | 61 kB 00:00 2022-09-17T10:24:51.452 INFO:teuthology.orchestra.run.smithi093.stdout:(67/128): python3-webtest-2.0.33-1.el8.noarch.r 2.9 MB/s | 85 kB 00:00 2022-09-17T10:24:51.471 INFO:teuthology.orchestra.run.smithi093.stdout:(68/128): python3-webob-1.8.5-1.el8.1.noarch.rp 3.0 MB/s | 251 kB 00:00 2022-09-17T10:24:51.474 INFO:teuthology.orchestra.run.smithi093.stdout:(69/128): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2022-09-17T10:24:51.482 INFO:teuthology.orchestra.run.smithi093.stdout:(70/128): python3-zc-lockfile-2.0-2.el8.noarch. 814 kB/s | 23 kB 00:00 2022-09-17T10:24:51.500 INFO:teuthology.orchestra.run.smithi093.stdout:(71/128): pcre2-devel-10.32-2.el8.x86_64.rpm 25 MB/s | 605 kB 00:00 2022-09-17T10:24:51.501 INFO:teuthology.orchestra.run.smithi093.stdout:(72/128): pcre2-utf32-10.32-2.el8.x86_64.rpm 11 MB/s | 220 kB 00:00 2022-09-17T10:24:51.520 INFO:teuthology.orchestra.run.smithi093.stdout:(73/128): python3-cryptography-3.2.1-4.el8.x86_ 31 MB/s | 559 kB 00:00 2022-09-17T10:24:51.531 INFO:teuthology.orchestra.run.smithi093.stdout:(74/128): openssl-devel-1.1.1g-15.el8_3.x86_64. 72 MB/s | 2.3 MB 00:00 2022-09-17T10:24:51.539 INFO:teuthology.orchestra.run.smithi093.stdout:(75/128): libcom_err-devel-1.45.6-1.el8.x86_64. 2.0 MB/s | 38 kB 00:00 2022-09-17T10:24:51.545 INFO:teuthology.orchestra.run.smithi093.stdout:(76/128): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.6 MB/s | 48 kB 00:00 2022-09-17T10:24:51.554 INFO:teuthology.orchestra.run.smithi093.stdout:(77/128): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2022-09-17T10:24:51.559 INFO:teuthology.orchestra.run.smithi093.stdout:(78/128): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2022-09-17T10:24:51.567 INFO:teuthology.orchestra.run.smithi093.stdout:(79/128): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.7 MB/s | 47 kB 00:00 2022-09-17T10:24:51.575 INFO:teuthology.orchestra.run.smithi093.stdout:(80/128): fuse-2.9.7-12.el8.x86_64.rpm 5.1 MB/s | 83 kB 00:00 2022-09-17T10:24:51.583 INFO:teuthology.orchestra.run.smithi093.stdout:(81/128): python3-oauthlib-2.1.0-1.el8.noarch.r 9.1 MB/s | 155 kB 00:00 2022-09-17T10:24:51.590 INFO:teuthology.orchestra.run.smithi093.stdout:(82/128): python3-pycparser-2.14-14.el8.noarch. 7.8 MB/s | 109 kB 00:00 2022-09-17T10:24:51.597 INFO:teuthology.orchestra.run.smithi093.stdout:(83/128): elfutils-libelf-devel-0.182-3.el8.x86 4.4 MB/s | 59 kB 00:00 2022-09-17T10:24:51.603 INFO:teuthology.orchestra.run.smithi093.stdout:(84/128): python3-jwt-1.6.1-2.el8.noarch.rpm 3.0 MB/s | 43 kB 00:00 2022-09-17T10:24:51.610 INFO:teuthology.orchestra.run.smithi093.stdout:(85/128): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.5 MB/s | 70 kB 00:00 2022-09-17T10:24:51.617 INFO:teuthology.orchestra.run.smithi093.stdout:(86/128): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.4 MB/s | 19 kB 00:00 2022-09-17T10:24:51.631 INFO:teuthology.orchestra.run.smithi093.stdout:(87/128): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 33 MB/s | 559 kB 00:00 2022-09-17T10:24:51.632 INFO:teuthology.orchestra.run.smithi093.stdout:(88/128): python3-cffi-1.11.5-5.el8.x86_64.rpm 16 MB/s | 238 kB 00:00 2022-09-17T10:24:51.645 INFO:teuthology.orchestra.run.smithi093.stdout:(89/128): pcre2-utf16-10.32-2.el8.x86_64.rpm 16 MB/s | 229 kB 00:00 2022-09-17T10:24:51.647 INFO:teuthology.orchestra.run.smithi093.stdout:(90/128): python3-requests-oauthlib-1.0.0-1.el8 3.0 MB/s | 43 kB 00:00 2022-09-17T10:24:51.656 INFO:teuthology.orchestra.run.smithi093.stdout:(91/128): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2022-09-17T10:24:51.660 INFO:teuthology.orchestra.run.smithi093.stdout:(92/128): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.0 MB/s | 58 kB 00:00 2022-09-17T10:24:51.669 INFO:teuthology.orchestra.run.smithi093.stdout:(93/128): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.3 MB/s | 97 kB 00:00 2022-09-17T10:24:51.678 INFO:teuthology.orchestra.run.smithi093.stdout:(94/128): libsepol-devel-2.9-2.el8.x86_64.rpm 6.3 MB/s | 86 kB 00:00 2022-09-17T10:24:51.685 INFO:teuthology.orchestra.run.smithi093.stdout:(95/128): libgfortran-8.4.1-1.el8.x86_64.rpm 39 MB/s | 639 kB 00:00 2022-09-17T10:24:51.694 INFO:teuthology.orchestra.run.smithi159.stdout:(29/128): rbd-mirror-16.2.10-818.g9f1013ad.el8. 5.0 MB/s | 3.7 MB 00:00 2022-09-17T10:24:51.699 INFO:teuthology.orchestra.run.smithi093.stdout:(96/128): socat-1.7.3.3-2.el8.x86_64.rpm 21 MB/s | 302 kB 00:00 2022-09-17T10:24:51.722 INFO:teuthology.orchestra.run.smithi093.stdout:(97/128): openblas-0.3.12-1.el8.x86_64.rpm 96 MB/s | 4.6 MB 00:00 2022-09-17T10:24:51.730 INFO:teuthology.orchestra.run.smithi093.stdout:(98/128): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2022-09-17T10:24:51.737 INFO:teuthology.orchestra.run.smithi093.stdout:(99/128): python3-markupsafe-0.23-19.el8.x86_64 2.6 MB/s | 39 kB 00:00 2022-09-17T10:24:51.741 INFO:teuthology.orchestra.run.smithi093.stdout:(100/128): python3-prettytable-0.7.2-14.el8.noa 3.2 MB/s | 44 kB 00:00 2022-09-17T10:24:51.755 INFO:teuthology.orchestra.run.smithi093.stdout:(101/128): python3-werkzeug-0.12.2-4.el8.noarch 30 MB/s | 457 kB 00:00 2022-09-17T10:24:51.757 INFO:teuthology.orchestra.run.smithi093.stdout:(102/128): python3-numpy-f2py-1.14.3-9.el8.x86_ 14 MB/s | 225 kB 00:00 2022-09-17T10:24:51.767 INFO:teuthology.orchestra.run.smithi093.stdout:(103/128): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2022-09-17T10:24:51.785 INFO:teuthology.orchestra.run.smithi093.stdout:(104/128): libtool-2.4.6-25.el8.x86_64.rpm 38 MB/s | 709 kB 00:00 2022-09-17T10:24:51.806 INFO:teuthology.orchestra.run.smithi093.stdout:(105/128): openblas-threads-0.3.12-1.el8.x86_64 96 MB/s | 4.7 MB 00:00 2022-09-17T10:24:51.808 INFO:teuthology.orchestra.run.smithi093.stdout:(106/128): python3-mako-1.0.6-13.el8.noarch.rpm 6.6 MB/s | 157 kB 00:00 2022-09-17T10:24:51.819 INFO:teuthology.orchestra.run.smithi093.stdout:(107/128): python3-pyOpenSSL-19.0.0-1.el8.noarc 7.9 MB/s | 103 kB 00:00 2022-09-17T10:24:51.836 INFO:teuthology.orchestra.run.smithi093.stdout:(108/128): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2022-09-17T10:24:51.850 INFO:teuthology.orchestra.run.smithi093.stdout:(109/128): python3-numpy-1.14.3-9.el8.x86_64.rp 89 MB/s | 3.7 MB 00:00 2022-09-17T10:24:51.860 INFO:teuthology.orchestra.run.smithi093.stdout:(110/128): flex-2.6.1-9.el8.x86_64.rpm 13 MB/s | 320 kB 00:00 2022-09-17T10:24:51.875 INFO:teuthology.orchestra.run.smithi093.stdout:(111/128): python3-pytz-2017.2-9.el8.noarch.rpm 3.3 MB/s | 54 kB 00:00 2022-09-17T10:24:51.894 INFO:teuthology.orchestra.run.smithi093.stdout:(112/128): python3-jinja2-2.10.1-2.el8_0.noarch 34 MB/s | 538 kB 00:00 2022-09-17T10:24:51.904 INFO:teuthology.orchestra.run.smithi093.stdout:(113/128): python3-jsonpointer-1.10-11.el8.noar 1.6 MB/s | 20 kB 00:00 2022-09-17T10:24:51.918 INFO:teuthology.orchestra.run.smithi093.stdout:(114/128): lttng-ust-2.8.1-11.el8.x86_64.rpm 18 MB/s | 259 kB 00:00 2022-09-17T10:24:51.924 INFO:teuthology.orchestra.run.smithi159.stdout:(30/128): ceph-mgr-dashboard-16.2.10-818.g9f101 4.0 MB/s | 3.1 MB 00:00 2022-09-17T10:24:51.933 INFO:teuthology.orchestra.run.smithi093.stdout:(115/128): python3-pyasn1-0.3.7-6.el8.noarch.rp 9.0 MB/s | 126 kB 00:00 2022-09-17T10:24:51.978 INFO:teuthology.orchestra.run.smithi159.stdout:(31/128): ceph-mgr-modules-core-16.2.10-818.g9f 4.4 MB/s | 241 kB 00:00 2022-09-17T10:24:52.006 INFO:teuthology.orchestra.run.smithi159.stdout:(32/128): ceph-mgr-rook-16.2.10-818.g9f1013ad.e 983 kB/s | 27 kB 00:00 2022-09-17T10:24:52.034 INFO:teuthology.orchestra.run.smithi159.stdout:(33/128): ceph-prometheus-alerts-16.2.10-818.g9 535 kB/s | 15 kB 00:00 2022-09-17T10:24:52.041 INFO:teuthology.orchestra.run.smithi093.stdout:(116/128): python3-scipy-1.0.0-20.module+el8.1. 77 MB/s | 15 MB 00:00 2022-09-17T10:24:52.051 INFO:teuthology.orchestra.run.smithi062.stdout:(128/128): ceph-test-16.2.10-818.g9f1013ad.el8. 5.5 MB/s | 52 MB 00:09 2022-09-17T10:24:52.055 INFO:teuthology.orchestra.run.smithi093.stdout:(117/128): python3-jsonpatch-1.21-2.el8.noarch. 2.1 MB/s | 27 kB 00:00 2022-09-17T10:24:52.062 INFO:teuthology.orchestra.run.smithi159.stdout:(34/128): cephadm-16.2.10-818.g9f1013ad.el8.noa 3.5 MB/s | 82 kB 00:00 2022-09-17T10:24:52.062 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2022-09-17T10:24:52.063 INFO:teuthology.orchestra.run.smithi062.stdout:Total 12 MB/s | 206 MB 00:16 2022-09-17T10:24:52.068 INFO:teuthology.orchestra.run.smithi093.stdout:(118/128): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2022-09-17T10:24:52.085 INFO:teuthology.orchestra.run.smithi159.stdout:(35/128): cephfs-top-16.2.10-818.g9f1013ad.el8. 529 kB/s | 14 kB 00:00 2022-09-17T10:24:52.089 INFO:teuthology.orchestra.run.smithi093.stdout:(119/128): python3-babel-2.5.1-5.el8.noarch.rpm 31 MB/s | 4.8 MB 00:00 2022-09-17T10:24:52.095 INFO:teuthology.orchestra.run.smithi093.stdout:(120/128): automake-1.16.1-7.el8.noarch.rpm 25 MB/s | 713 kB 00:00 2022-09-17T10:24:52.103 INFO:teuthology.orchestra.run.smithi093.stdout:(121/128): python3-pyasn1-modules-0.3.7-6.el8.n 7.6 MB/s | 110 kB 00:00 2022-09-17T10:24:52.126 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2022-09-17T10:24:52.254 INFO:teuthology.orchestra.run.smithi159.stdout:(36/128): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2022-09-17T10:24:52.265 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2022-09-17T10:24:52.265 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2022-09-17T10:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout:(37/128): leveldb-1.22-1.el8.x86_64.rpm 4.5 MB/s | 181 kB 00:00 2022-09-17T10:24:52.337 INFO:teuthology.orchestra.run.smithi159.stdout:(38/128): liboath-2.6.2-3.el8.x86_64.rpm 1.3 MB/s | 59 kB 00:00 2022-09-17T10:24:52.379 INFO:teuthology.orchestra.run.smithi159.stdout:(39/128): libunwind-1.3.1-3.el8.x86_64.rpm 1.7 MB/s | 75 kB 00:00 2022-09-17T10:24:52.429 INFO:teuthology.orchestra.run.smithi159.stdout:(40/128): python3-apipkg-1.5-6.el8.noarch.rpm 434 kB/s | 21 kB 00:00 2022-09-17T10:24:52.469 INFO:teuthology.orchestra.run.smithi159.stdout:(41/128): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.1 MB/s | 44 kB 00:00 2022-09-17T10:24:52.508 INFO:teuthology.orchestra.run.smithi159.stdout:(42/128): python3-beautifulsoup4-4.6.3-2.el8.1. 4.6 MB/s | 185 kB 00:00 2022-09-17T10:24:52.544 INFO:teuthology.orchestra.run.smithi159.stdout:(43/128): python3-cachetools-3.1.1-4.el8.noarch 939 kB/s | 33 kB 00:00 2022-09-17T10:24:52.554 INFO:teuthology.orchestra.run.smithi093.stdout:(122/128): ceph-test-16.2.10-818.g9f1013ad.el8. 5.3 MB/s | 52 MB 00:09 2022-09-17T10:24:52.570 INFO:teuthology.orchestra.run.smithi093.stdout:(123/128): NetworkManager-tui-1.30.0-13.el8_4.x 21 MB/s | 329 kB 00:00 2022-09-17T10:24:52.571 INFO:teuthology.orchestra.run.smithi159.stdout:(44/128): python3-certifi-2018.10.15-7.el8.noar 602 kB/s | 16 kB 00:00 2022-09-17T10:24:52.604 INFO:teuthology.orchestra.run.smithi093.stdout:(124/128): NetworkManager-1.30.0-13.el8_4.x86_6 77 MB/s | 2.6 MB 00:00 2022-09-17T10:24:52.609 INFO:teuthology.orchestra.run.smithi159.stdout:(45/128): ceph-mgr-diskprediction-local-16.2.10 9.4 MB/s | 8.6 MB 00:00 2022-09-17T10:24:52.615 INFO:teuthology.orchestra.run.smithi159.stdout:(46/128): python3-cheroot-8.5.2-1.el8.noarch.rp 3.8 MB/s | 173 kB 00:00 2022-09-17T10:24:52.618 INFO:teuthology.orchestra.run.smithi093.stdout:(125/128): NetworkManager-team-1.30.0-13.el8_4. 10 MB/s | 146 kB 00:00 2022-09-17T10:24:52.644 INFO:teuthology.orchestra.run.smithi093.stdout:(126/128): NetworkManager-libnm-1.30.0-13.el8_4 69 MB/s | 1.8 MB 00:00 2022-09-17T10:24:52.745 INFO:teuthology.orchestra.run.smithi159.stdout:(47/128): python3-execnet-1.7.1-1.el8.noarch.rp 2.7 MB/s | 355 kB 00:00 2022-09-17T10:24:52.786 INFO:teuthology.orchestra.run.smithi093.stdout:(127/128): librbd1-16.2.10-818.g9f1013ad.el8.x8 6.1 MB/s | 4.2 MB 00:00 2022-09-17T10:24:52.791 INFO:teuthology.orchestra.run.smithi159.stdout:(48/128): python3-google-auth-1.1.1-10.el8.noar 1.7 MB/s | 81 kB 00:00 2022-09-17T10:24:52.815 INFO:teuthology.orchestra.run.smithi159.stdout:(49/128): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2022-09-17T10:24:52.832 INFO:teuthology.orchestra.run.smithi159.stdout:(50/128): python3-jaraco-6.2-6.el8.noarch.rpm 272 kB/s | 11 kB 00:00 2022-09-17T10:24:52.854 INFO:teuthology.orchestra.run.smithi159.stdout:(51/128): python3-jaraco-functools-2.0-4.el8.no 449 kB/s | 18 kB 00:00 2022-09-17T10:24:52.894 INFO:teuthology.orchestra.run.smithi159.stdout:(52/128): python3-logutils-0.3.5-11.el8.noarch. 1.2 MB/s | 49 kB 00:00 2022-09-17T10:24:52.930 INFO:teuthology.orchestra.run.smithi093.stdout:(128/128): librados2-16.2.10-818.g9f1013ad.el8. 4.5 MB/s | 3.7 MB 00:00 2022-09-17T10:24:52.932 INFO:teuthology.orchestra.run.smithi159.stdout:(53/128): python3-more-itertools-7.2.0-3.el8.no 1.5 MB/s | 59 kB 00:00 2022-09-17T10:24:52.934 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2022-09-17T10:24:52.934 INFO:teuthology.orchestra.run.smithi093.stdout:Total 11 MB/s | 206 MB 00:18 2022-09-17T10:24:52.966 INFO:teuthology.orchestra.run.smithi159.stdout:(54/128): python3-kubernetes-11.0.0-6.el8.noarc 8.7 MB/s | 1.2 MB 00:00 2022-09-17T10:24:52.979 INFO:teuthology.orchestra.run.smithi159.stdout:(55/128): python3-pecan-1.3.2-9.el8.noarch.rpm 6.0 MB/s | 283 kB 00:00 2022-09-17T10:24:52.994 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2022-09-17T10:24:53.005 INFO:teuthology.orchestra.run.smithi159.stdout:(56/128): python3-portend-2.6-1.el8.noarch.rpm 398 kB/s | 16 kB 00:00 2022-09-17T10:24:53.021 INFO:teuthology.orchestra.run.smithi159.stdout:(57/128): python3-remoto-1.2.1-1.el8.noarch.rpm 1.1 MB/s | 49 kB 00:00 2022-09-17T10:24:53.044 INFO:teuthology.orchestra.run.smithi159.stdout:(58/128): python3-repoze-lru-0.7-6.el8.noarch.r 868 kB/s | 34 kB 00:00 2022-09-17T10:24:53.074 INFO:teuthology.orchestra.run.smithi159.stdout:(59/128): python3-routes-2.4.1-12.el8.noarch.rp 3.7 MB/s | 196 kB 00:00 2022-09-17T10:24:53.101 INFO:teuthology.orchestra.run.smithi159.stdout:(60/128): python3-rsa-4.8-1.el8.noarch.rpm 1.1 MB/s | 61 kB 00:00 2022-09-17T10:24:53.122 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2022-09-17T10:24:53.123 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2022-09-17T10:24:53.145 INFO:teuthology.orchestra.run.smithi159.stdout:(61/128): python3-singledispatch-3.4.0.3-18.el8 651 kB/s | 24 kB 00:00 2022-09-17T10:24:53.149 INFO:teuthology.orchestra.run.smithi159.stdout:(62/128): python3-simplegeneric-0.8.1-17.el8.no 250 kB/s | 19 kB 00:00 2022-09-17T10:24:53.165 INFO:teuthology.orchestra.run.smithi159.stdout:(63/128): python3-tempora-1.14.1-5.el8.noarch.r 1.1 MB/s | 29 kB 00:00 2022-09-17T10:24:53.189 INFO:teuthology.orchestra.run.smithi159.stdout:(64/128): python3-trustme-0.6.0-4.el8.noarch.rp 686 kB/s | 27 kB 00:00 2022-09-17T10:24:53.209 INFO:teuthology.orchestra.run.smithi159.stdout:(65/128): python3-waitress-1.2.1-2.el8.1.noarch 5.3 MB/s | 241 kB 00:00 2022-09-17T10:24:53.232 INFO:teuthology.orchestra.run.smithi159.stdout:(66/128): python3-webob-1.8.5-1.el8.1.noarch.rp 5.8 MB/s | 251 kB 00:00 2022-09-17T10:24:53.272 INFO:teuthology.orchestra.run.smithi159.stdout:(67/128): python3-webtest-2.0.33-1.el8.noarch.r 2.1 MB/s | 85 kB 00:00 2022-09-17T10:24:53.283 INFO:teuthology.orchestra.run.smithi159.stdout:(68/128): python3-websocket-client-0.56.0-5.el8 829 kB/s | 61 kB 00:00 2022-09-17T10:24:53.287 INFO:teuthology.orchestra.run.smithi159.stdout:(69/128): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2022-09-17T10:24:53.311 INFO:teuthology.orchestra.run.smithi159.stdout:(70/128): python3-zc-lockfile-2.0-2.el8.noarch. 581 kB/s | 23 kB 00:00 2022-09-17T10:24:53.313 INFO:teuthology.orchestra.run.smithi159.stdout:(71/128): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2022-09-17T10:24:53.327 INFO:teuthology.orchestra.run.smithi159.stdout:(72/128): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2022-09-17T10:24:53.344 INFO:teuthology.orchestra.run.smithi159.stdout:(73/128): python3-cryptography-3.2.1-4.el8.x86_ 34 MB/s | 559 kB 00:00 2022-09-17T10:24:53.352 INFO:teuthology.orchestra.run.smithi159.stdout:(74/128): openssl-devel-1.1.1g-15.el8_3.x86_64. 60 MB/s | 2.3 MB 00:00 2022-09-17T10:24:53.364 INFO:teuthology.orchestra.run.smithi159.stdout:(75/128): libcom_err-devel-1.45.6-1.el8.x86_64. 1.9 MB/s | 38 kB 00:00 2022-09-17T10:24:53.368 INFO:teuthology.orchestra.run.smithi159.stdout:(76/128): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.2 MB/s | 48 kB 00:00 2022-09-17T10:24:53.380 INFO:teuthology.orchestra.run.smithi159.stdout:(77/128): libselinux-devel-2.9-5.el8.x86_64.rpm 12 MB/s | 200 kB 00:00 2022-09-17T10:24:53.381 INFO:teuthology.orchestra.run.smithi159.stdout:(78/128): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2022-09-17T10:24:53.394 INFO:teuthology.orchestra.run.smithi159.stdout:(79/128): fuse-2.9.7-12.el8.x86_64.rpm 6.3 MB/s | 83 kB 00:00 2022-09-17T10:24:53.396 INFO:teuthology.orchestra.run.smithi159.stdout:(80/128): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.9 MB/s | 47 kB 00:00 2022-09-17T10:24:53.408 INFO:teuthology.orchestra.run.smithi159.stdout:(81/128): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2022-09-17T10:24:53.410 INFO:teuthology.orchestra.run.smithi159.stdout:(82/128): python3-pycparser-2.14-14.el8.noarch. 8.4 MB/s | 109 kB 00:00 2022-09-17T10:24:53.416 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2022-09-17T10:24:53.420 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2022-09-17T10:24:53.421 INFO:teuthology.orchestra.run.smithi159.stdout:(83/128): elfutils-libelf-devel-0.182-3.el8.x86 4.5 MB/s | 59 kB 00:00 2022-09-17T10:24:53.425 INFO:teuthology.orchestra.run.smithi159.stdout:(84/128): python3-jwt-1.6.1-2.el8.noarch.rpm 3.1 MB/s | 43 kB 00:00 2022-09-17T10:24:53.435 INFO:teuthology.orchestra.run.smithi159.stdout:(85/128): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.4 MB/s | 70 kB 00:00 2022-09-17T10:24:53.438 INFO:teuthology.orchestra.run.smithi159.stdout:(86/128): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.5 MB/s | 19 kB 00:00 2022-09-17T10:24:53.450 INFO:teuthology.orchestra.run.smithi159.stdout:(87/128): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 36 MB/s | 559 kB 00:00 2022-09-17T10:24:53.454 INFO:teuthology.orchestra.run.smithi159.stdout:(88/128): python3-cffi-1.11.5-5.el8.x86_64.rpm 17 MB/s | 238 kB 00:00 2022-09-17T10:24:53.463 INFO:teuthology.orchestra.run.smithi159.stdout:(89/128): pcre2-utf16-10.32-2.el8.x86_64.rpm 16 MB/s | 229 kB 00:00 2022-09-17T10:24:53.465 INFO:teuthology.orchestra.run.smithi159.stdout:(90/128): python3-requests-oauthlib-1.0.0-1.el8 3.3 MB/s | 43 kB 00:00 2022-09-17T10:24:53.477 INFO:teuthology.orchestra.run.smithi159.stdout:(91/128): libquadmath-8.4.1-1.el8.x86_64.rpm 13 MB/s | 169 kB 00:00 2022-09-17T10:24:53.479 INFO:teuthology.orchestra.run.smithi159.stdout:(92/128): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.4 MB/s | 58 kB 00:00 2022-09-17T10:24:53.491 INFO:teuthology.orchestra.run.smithi159.stdout:(93/128): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.8 MB/s | 97 kB 00:00 2022-09-17T10:24:53.492 INFO:teuthology.orchestra.run.smithi159.stdout:(94/128): libsepol-devel-2.9-2.el8.x86_64.rpm 6.2 MB/s | 86 kB 00:00 2022-09-17T10:24:53.508 INFO:teuthology.orchestra.run.smithi159.stdout:(95/128): libgfortran-8.4.1-1.el8.x86_64.rpm 39 MB/s | 639 kB 00:00 2022-09-17T10:24:53.522 INFO:teuthology.orchestra.run.smithi159.stdout:(96/128): socat-1.7.3.3-2.el8.x86_64.rpm 20 MB/s | 302 kB 00:00 2022-09-17T10:24:53.546 INFO:teuthology.orchestra.run.smithi159.stdout:(97/128): openblas-0.3.12-1.el8.x86_64.rpm 86 MB/s | 4.6 MB 00:00 2022-09-17T10:24:53.552 INFO:teuthology.orchestra.run.smithi159.stdout:(98/128): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2022-09-17T10:24:53.560 INFO:teuthology.orchestra.run.smithi159.stdout:(99/128): python3-markupsafe-0.23-19.el8.x86_64 2.8 MB/s | 39 kB 00:00 2022-09-17T10:24:53.566 INFO:teuthology.orchestra.run.smithi159.stdout:(100/128): python3-prettytable-0.7.2-14.el8.noa 3.5 MB/s | 44 kB 00:00 2022-09-17T10:24:53.577 INFO:teuthology.orchestra.run.smithi159.stdout:(101/128): python3-werkzeug-0.12.2-4.el8.noarch 27 MB/s | 457 kB 00:00 2022-09-17T10:24:53.579 INFO:teuthology.orchestra.run.smithi159.stdout:(102/128): python3-numpy-f2py-1.14.3-9.el8.x86_ 14 MB/s | 225 kB 00:00 2022-09-17T10:24:53.591 INFO:teuthology.orchestra.run.smithi159.stdout:(103/128): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2022-09-17T10:24:53.610 INFO:teuthology.orchestra.run.smithi159.stdout:(104/128): libtool-2.4.6-25.el8.x86_64.rpm 38 MB/s | 709 kB 00:00 2022-09-17T10:24:53.634 INFO:teuthology.orchestra.run.smithi159.stdout:(105/128): openblas-threads-0.3.12-1.el8.x86_64 88 MB/s | 4.7 MB 00:00 2022-09-17T10:24:53.635 INFO:teuthology.orchestra.run.smithi159.stdout:(106/128): python3-mako-1.0.6-13.el8.noarch.rpm 5.9 MB/s | 157 kB 00:00 2022-09-17T10:24:53.648 INFO:teuthology.orchestra.run.smithi159.stdout:(107/128): python3-pyOpenSSL-19.0.0-1.el8.noarc 7.4 MB/s | 103 kB 00:00 2022-09-17T10:24:53.663 INFO:teuthology.orchestra.run.smithi159.stdout:(108/128): librdkafka-0.11.4-1.el8.x86_64.rpm 23 MB/s | 353 kB 00:00 2022-09-17T10:24:53.682 INFO:teuthology.orchestra.run.smithi159.stdout:(109/128): python3-numpy-1.14.3-9.el8.x86_64.rp 82 MB/s | 3.7 MB 00:00 2022-09-17T10:24:53.684 INFO:teuthology.orchestra.run.smithi159.stdout:(110/128): flex-2.6.1-9.el8.x86_64.rpm 15 MB/s | 320 kB 00:00 2022-09-17T10:24:53.699 INFO:teuthology.orchestra.run.smithi159.stdout:(111/128): python3-pytz-2017.2-9.el8.noarch.rpm 3.7 MB/s | 54 kB 00:00 2022-09-17T10:24:53.717 INFO:teuthology.orchestra.run.smithi159.stdout:(112/128): python3-jinja2-2.10.1-2.el8_0.noarch 31 MB/s | 538 kB 00:00 2022-09-17T10:24:53.729 INFO:teuthology.orchestra.run.smithi159.stdout:(113/128): python3-jsonpointer-1.10-11.el8.noar 1.6 MB/s | 20 kB 00:00 2022-09-17T10:24:53.744 INFO:teuthology.orchestra.run.smithi159.stdout:(114/128): lttng-ust-2.8.1-11.el8.x86_64.rpm 18 MB/s | 259 kB 00:00 2022-09-17T10:24:53.757 INFO:teuthology.orchestra.run.smithi159.stdout:(115/128): python3-pyasn1-0.3.7-6.el8.noarch.rp 9.5 MB/s | 126 kB 00:00 2022-09-17T10:24:53.895 INFO:teuthology.orchestra.run.smithi159.stdout:(116/128): python3-scipy-1.0.0-20.module+el8.1. 68 MB/s | 15 MB 00:00 2022-09-17T10:24:53.907 INFO:teuthology.orchestra.run.smithi159.stdout:(117/128): python3-jsonpatch-1.21-2.el8.noarch. 2.1 MB/s | 27 kB 00:00 2022-09-17T10:24:53.929 INFO:teuthology.orchestra.run.smithi159.stdout:(118/128): python3-babel-2.5.1-5.el8.noarch.rpm 28 MB/s | 4.8 MB 00:00 2022-09-17T10:24:53.931 INFO:teuthology.orchestra.run.smithi159.stdout:(119/128): jq-1.5-12.el8.x86_64.rpm 6.7 MB/s | 161 kB 00:00 2022-09-17T10:24:53.947 INFO:teuthology.orchestra.run.smithi159.stdout:(120/128): automake-1.16.1-7.el8.noarch.rpm 40 MB/s | 713 kB 00:00 2022-09-17T10:24:53.948 INFO:teuthology.orchestra.run.smithi159.stdout:(121/128): python3-pyasn1-modules-0.3.7-6.el8.n 6.4 MB/s | 110 kB 00:00 2022-09-17T10:24:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2022-09-17T10:24:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2022-09-17T10:24:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:(122/128): librados2-16.2.10-818.g9f1013ad.el8. 8.8 MB/s | 3.7 MB 00:00 2022-09-17T10:24:54.390 INFO:teuthology.orchestra.run.smithi159.stdout:(123/128): NetworkManager-tui-1.30.0-13.el8_4.x 22 MB/s | 329 kB 00:00 2022-09-17T10:24:54.418 INFO:teuthology.orchestra.run.smithi159.stdout:(124/128): NetworkManager-1.30.0-13.el8_4.x86_6 88 MB/s | 2.6 MB 00:00 2022-09-17T10:24:54.433 INFO:teuthology.orchestra.run.smithi159.stdout:(125/128): NetworkManager-team-1.30.0-13.el8_4. 11 MB/s | 146 kB 00:00 2022-09-17T10:24:54.464 INFO:teuthology.orchestra.run.smithi159.stdout:(126/128): NetworkManager-libnm-1.30.0-13.el8_4 74 MB/s | 1.8 MB 00:00 2022-09-17T10:24:54.583 INFO:teuthology.orchestra.run.smithi159.stdout:(127/128): librbd1-16.2.10-818.g9f1013ad.el8.x8 6.6 MB/s | 4.2 MB 00:00 2022-09-17T10:24:56.084 INFO:teuthology.orchestra.run.smithi159.stdout:(128/128): ceph-test-16.2.10-818.g9f1013ad.el8. 6.7 MB/s | 52 MB 00:07 2022-09-17T10:24:56.088 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2022-09-17T10:24:56.089 INFO:teuthology.orchestra.run.smithi159.stdout:Total 9.6 MB/s | 206 MB 00:21 2022-09-17T10:24:56.151 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2022-09-17T10:24:56.279 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2022-09-17T10:24:56.280 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2022-09-17T10:24:57.368 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2022-09-17T10:24:57.373 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2022-09-17T10:24:58.216 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2022-09-17T10:24:58.244 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2022-09-17T10:24:58.432 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/134 2022-09-17T10:24:58.633 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/134 2022-09-17T10:24:58.825 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2022-09-17T10:24:59.042 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2022-09-17T10:24:59.053 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2022-09-17T10:24:59.070 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2022-09-17T10:24:59.299 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/134 2022-09-17T10:24:59.450 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2022-09-17T10:24:59.670 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 5/134 2022-09-17T10:25:00.107 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 5/134 2022-09-17T10:25:00.204 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/134 2022-09-17T10:25:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:25:00.479 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:25:00.533 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/134 2022-09-17T10:25:00.661 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 7/134 2022-09-17T10:25:00.766 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 7/134 2022-09-17T10:25:00.908 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/134 2022-09-17T10:25:00.962 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 8/134 2022-09-17T10:25:01.111 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/134 2022-09-17T10:25:01.132 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 4/134 2022-09-17T10:25:01.513 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/134 2022-09-17T10:25:01.542 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 4/134 2022-09-17T10:25:01.728 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:25:01.732 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 5/134 2022-09-17T10:25:01.849 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:25:01.885 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 5/134 2022-09-17T10:25:02.066 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2022-09-17T10:25:02.073 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:25:02.174 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:25:02.227 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2022-09-17T10:25:02.378 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:25:02.414 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 7/134 2022-09-17T10:25:02.469 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:25:02.582 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/134 2022-09-17T10:25:02.636 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 14/134 2022-09-17T10:25:02.653 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/134 2022-09-17T10:25:02.680 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2022-09-17T10:25:02.708 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2022-09-17T10:25:02.907 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/134 2022-09-17T10:25:02.911 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 14/134 2022-09-17T10:25:03.109 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/134 2022-09-17T10:25:03.144 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2022-09-17T10:25:03.341 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/134 2022-09-17T10:25:03.374 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:25:03.475 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:25:03.600 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-09-17T10:25:03.663 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-09-17T10:25:03.708 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/134 2022-09-17T10:25:03.711 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2022-09-17T10:25:03.896 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2022-09-17T10:25:03.925 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:03.941 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 4/134 2022-09-17T10:25:04.049 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:25:04.157 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:25:04.178 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:04.323 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 14/134 2022-09-17T10:25:04.353 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 4/134 2022-09-17T10:25:04.500 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:04.590 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 5/134 2022-09-17T10:25:04.608 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 14/134 2022-09-17T10:25:04.701 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 17/134 2022-09-17T10:25:04.721 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 5/134 2022-09-17T10:25:04.877 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 18/134 2022-09-17T10:25:04.903 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-09-17T10:25:04.923 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:25:04.966 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-09-17T10:25:05.019 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 18/134 2022-09-17T10:25:05.026 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:25:05.169 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 19/134 2022-09-17T10:25:05.198 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:05.273 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 7/134 2022-09-17T10:25:05.482 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:05.590 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/134 2022-09-17T10:25:05.655 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/134 2022-09-17T10:25:05.733 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 19/134 2022-09-17T10:25:05.804 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:05.869 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.12-1.el8.x86_64 20/134 2022-09-17T10:25:06.054 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 17/134 2022-09-17T10:25:06.129 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2022-09-17T10:25:06.295 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/134 2022-09-17T10:25:06.323 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:25:06.420 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:25:06.452 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 20/134 2022-09-17T10:25:06.454 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 19/134 2022-09-17T10:25:06.595 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 20/134 2022-09-17T10:25:06.636 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/134 2022-09-17T10:25:06.669 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2022-09-17T10:25:06.766 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 21/134 2022-09-17T10:25:06.813 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2022-09-17T10:25:06.890 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 21/134 2022-09-17T10:25:06.948 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:25:07.056 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 22/134 2022-09-17T10:25:07.064 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:25:07.218 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 14/134 2022-09-17T10:25:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/134 2022-09-17T10:25:07.489 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 14/134 2022-09-17T10:25:07.588 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 22/134 2022-09-17T10:25:07.649 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 22/134 2022-09-17T10:25:07.764 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-0.3.12-1.el8.x86_64 23/134 2022-09-17T10:25:07.765 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-09-17T10:25:07.827 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 15/134 2022-09-17T10:25:07.958 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 23/134 2022-09-17T10:25:08.056 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:08.175 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/134 2022-09-17T10:25:08.315 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:08.316 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 23/134 2022-09-17T10:25:08.384 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 25/134 2022-09-17T10:25:08.531 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 24/134 2022-09-17T10:25:08.619 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.30.0-13.el8_4.x86_64 16/134 2022-09-17T10:25:08.624 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/134 2022-09-17T10:25:08.800 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:16.2.10-818.g9f1013ad.el8. 27/134 2022-09-17T10:25:08.880 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 17/134 2022-09-17T10:25:08.942 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el 28/134 2022-09-17T10:25:09.103 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/134 2022-09-17T10:25:09.148 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_6 29/134 2022-09-17T10:25:09.245 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 19/134 2022-09-17T10:25:09.266 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 24/134 2022-09-17T10:25:09.395 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 20/134 2022-09-17T10:25:09.550 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 25/134 2022-09-17T10:25:09.565 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 21/134 2022-09-17T10:25:09.685 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 21/134 2022-09-17T10:25:09.824 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/134 2022-09-17T10:25:09.856 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 22/134 2022-09-17T10:25:10.004 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-common-2:16.2.10-818.g9f1013ad.el8. 27/134 2022-09-17T10:25:10.137 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el 28/134 2022-09-17T10:25:10.288 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 30/134 2022-09-17T10:25:10.386 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 22/134 2022-09-17T10:25:10.391 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_6 29/134 2022-09-17T10:25:10.548 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.12-1.el8.x86_64 23/134 2022-09-17T10:25:10.589 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/134 2022-09-17T10:25:10.735 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/134 2022-09-17T10:25:10.995 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/134 2022-09-17T10:25:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 23/134 2022-09-17T10:25:11.193 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 33/134 2022-09-17T10:25:11.308 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 24/134 2022-09-17T10:25:12.039 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 24/134 2022-09-17T10:25:12.367 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 25/134 2022-09-17T10:25:12.582 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/134 2022-09-17T10:25:12.622 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/134 2022-09-17T10:25:12.795 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:16.2.10-818.g9f1013ad.el8. 27/134 2022-09-17T10:25:12.920 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el 28/134 2022-09-17T10:25:12.955 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 31/134 2022-09-17T10:25:13.185 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_6 29/134 2022-09-17T10:25:13.324 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 33/134 2022-09-17T10:25:13.372 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/134 2022-09-17T10:25:13.742 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 34/134 2022-09-17T10:25:13.961 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/134 2022-09-17T10:25:13.973 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/134 2022-09-17T10:25:14.131 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/134 2022-09-17T10:25:14.304 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 37/134 2022-09-17T10:25:14.329 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 33/134 2022-09-17T10:25:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 38/134 2022-09-17T10:25:14.544 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 34/134 2022-09-17T10:25:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_6 39/134 2022-09-17T10:25:14.779 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/134 2022-09-17T10:25:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 40/134 2022-09-17T10:25:14.950 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/134 2022-09-17T10:25:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/134 2022-09-17T10:25:15.147 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 37/134 2022-09-17T10:25:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2022-09-17T10:25:15.344 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 38/134 2022-09-17T10:25:15.386 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/134 2022-09-17T10:25:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2022-09-17T10:25:15.614 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_6 39/134 2022-09-17T10:25:15.717 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 31/134 2022-09-17T10:25:15.846 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : automake-1.16.1-7.el8.noarch 40/134 2022-09-17T10:25:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2022-09-17T10:25:16.004 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 41/134 2022-09-17T10:25:16.220 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 45/134 2022-09-17T10:25:16.241 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 42/134 2022-09-17T10:25:16.394 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2022-09-17T10:25:16.423 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2022-09-17T10:25:16.456 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2022-09-17T10:25:16.614 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : jq-1.5-12.el8.x86_64 44/134 2022-09-17T10:25:16.675 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2022-09-17T10:25:16.736 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/134 2022-09-17T10:25:16.833 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 45/134 2022-09-17T10:25:16.945 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2022-09-17T10:25:17.028 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 46/134 2022-09-17T10:25:17.073 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 33/134 2022-09-17T10:25:17.119 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2022-09-17T10:25:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 47/134 2022-09-17T10:25:17.296 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 50/134 2022-09-17T10:25:17.335 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 34/134 2022-09-17T10:25:17.408 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/134 2022-09-17T10:25:17.471 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 51/134 2022-09-17T10:25:17.521 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/134 2022-09-17T10:25:17.594 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 49/134 2022-09-17T10:25:17.629 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.7-12.el8.x86_64 52/134 2022-09-17T10:25:17.683 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/134 2022-09-17T10:25:17.795 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 53/134 2022-09-17T10:25:17.826 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 50/134 2022-09-17T10:25:17.889 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 37/134 2022-09-17T10:25:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/134 2022-09-17T10:25:18.093 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 38/134 2022-09-17T10:25:18.123 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 55/134 2022-09-17T10:25:18.226 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 51/134 2022-09-17T10:25:18.339 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_6 39/134 2022-09-17T10:25:18.449 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 56/134 2022-09-17T10:25:18.525 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 52/134 2022-09-17T10:25:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.1-7.el8.noarch 40/134 2022-09-17T10:25:18.722 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 41/134 2022-09-17T10:25:18.752 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 53/134 2022-09-17T10:25:18.774 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 57/134 2022-09-17T10:25:18.902 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 42/134 2022-09-17T10:25:19.014 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 54/134 2022-09-17T10:25:19.020 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/134 2022-09-17T10:25:19.071 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2022-09-17T10:25:19.138 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2022-09-17T10:25:19.286 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 55/134 2022-09-17T10:25:19.315 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 59/134 2022-09-17T10:25:19.330 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jq-1.5-12.el8.x86_64 44/134 2022-09-17T10:25:19.458 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 56/134 2022-09-17T10:25:19.503 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 45/134 2022-09-17T10:25:19.517 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.1-7.el8.noarch 60/134 2022-09-17T10:25:19.614 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 57/134 2022-09-17T10:25:19.685 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 61/134 2022-09-17T10:25:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 46/134 2022-09-17T10:25:19.864 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 62/134 2022-09-17T10:25:19.866 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 58/134 2022-09-17T10:25:19.904 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 47/134 2022-09-17T10:25:20.032 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/134 2022-09-17T10:25:20.050 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 63/134 2022-09-17T10:25:20.108 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/134 2022-09-17T10:25:20.139 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 63/134 2022-09-17T10:25:20.210 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 60/134 2022-09-17T10:25:20.295 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 49/134 2022-09-17T10:25:20.303 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jq-1.5-12.el8.x86_64 64/134 2022-09-17T10:25:20.351 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 61/134 2022-09-17T10:25:20.476 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 65/134 2022-09-17T10:25:20.498 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 62/134 2022-09-17T10:25:20.501 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 50/134 2022-09-17T10:25:20.646 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 66/134 2022-09-17T10:25:20.803 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2022-09-17T10:25:20.831 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2022-09-17T10:25:20.929 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 51/134 2022-09-17T10:25:20.996 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2022-09-17T10:25:21.096 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2022-09-17T10:25:21.197 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 52/134 2022-09-17T10:25:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2022-09-17T10:25:21.370 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2022-09-17T10:25:21.400 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 53/134 2022-09-17T10:25:21.417 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2022-09-17T10:25:21.573 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2022-09-17T10:25:21.598 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 66/134 2022-09-17T10:25:21.675 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 54/134 2022-09-17T10:25:21.766 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2022-09-17T10:25:21.788 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2022-09-17T10:25:21.911 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 55/134 2022-09-17T10:25:21.961 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2022-09-17T10:25:21.975 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2022-09-17T10:25:22.072 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 56/134 2022-09-17T10:25:22.206 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2022-09-17T10:25:22.247 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2022-09-17T10:25:22.257 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 57/134 2022-09-17T10:25:22.388 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 75/134 2022-09-17T10:25:22.420 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2022-09-17T10:25:22.489 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 58/134 2022-09-17T10:25:22.542 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 76/134 2022-09-17T10:25:22.567 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2022-09-17T10:25:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/134 2022-09-17T10:25:22.749 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2022-09-17T10:25:22.786 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 77/134 2022-09-17T10:25:22.787 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 60/134 2022-09-17T10:25:22.939 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2022-09-17T10:25:22.968 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 61/134 2022-09-17T10:25:23.015 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 78/134 2022-09-17T10:25:23.125 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 62/134 2022-09-17T10:25:23.196 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2022-09-17T10:25:23.224 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 79/134 2022-09-17T10:25:23.365 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 75/134 2022-09-17T10:25:23.425 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2022-09-17T10:25:23.487 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-2.6-1.el8.noarch 80/134 2022-09-17T10:25:23.510 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 76/134 2022-09-17T10:25:23.697 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2022-09-17T10:25:23.734 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/134 2022-09-17T10:25:23.753 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 77/134 2022-09-17T10:25:23.911 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 82/134 2022-09-17T10:25:23.961 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2022-09-17T10:25:23.966 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 78/134 2022-09-17T10:25:24.138 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 83/134 2022-09-17T10:25:24.177 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 79/134 2022-09-17T10:25:24.216 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 66/134 2022-09-17T10:25:24.404 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2022-09-17T10:25:24.443 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-portend-2.6-1.el8.noarch 80/134 2022-09-17T10:25:24.609 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2022-09-17T10:25:24.703 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/134 2022-09-17T10:25:24.861 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 82/134 2022-09-17T10:25:24.864 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2022-09-17T10:25:25.052 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 83/134 2022-09-17T10:25:25.094 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2022-09-17T10:25:25.234 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2022-09-17T10:25:25.343 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 84/134 2022-09-17T10:25:25.390 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2022-09-17T10:25:25.565 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2022-09-17T10:25:25.650 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/134 2022-09-17T10:25:25.826 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2022-09-17T10:25:25.887 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 86/134 2022-09-17T10:25:25.973 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 75/134 2022-09-17T10:25:26.119 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 76/134 2022-09-17T10:25:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 87/134 2022-09-17T10:25:26.217 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 84/134 2022-09-17T10:25:26.361 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 77/134 2022-09-17T10:25:26.433 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/134 2022-09-17T10:25:26.561 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/134 2022-09-17T10:25:26.584 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 78/134 2022-09-17T10:25:26.722 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 89/134 2022-09-17T10:25:26.769 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 79/134 2022-09-17T10:25:26.781 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 86/134 2022-09-17T10:25:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 90/134 2022-09-17T10:25:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-2.6-1.el8.noarch 80/134 2022-09-17T10:25:27.099 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 87/134 2022-09-17T10:25:27.226 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 91/134 2022-09-17T10:25:27.346 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/134 2022-09-17T10:25:27.360 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/134 2022-09-17T10:25:27.444 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/134 2022-09-17T10:25:27.523 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 82/134 2022-09-17T10:25:27.650 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/134 2022-09-17T10:25:27.669 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 89/134 2022-09-17T10:25:27.755 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 83/134 2022-09-17T10:25:27.971 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 90/134 2022-09-17T10:25:28.237 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 91/134 2022-09-17T10:25:28.453 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/134 2022-09-17T10:25:28.662 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/134 2022-09-17T10:25:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 84/134 2022-09-17T10:25:29.219 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/134 2022-09-17T10:25:29.438 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 86/134 2022-09-17T10:25:29.759 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 87/134 2022-09-17T10:25:30.061 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/134 2022-09-17T10:25:30.346 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 89/134 2022-09-17T10:25:30.660 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 90/134 2022-09-17T10:25:30.862 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 91/134 2022-09-17T10:25:31.128 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/134 2022-09-17T10:25:31.312 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/134 2022-09-17T10:25:32.540 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:32.766 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:33.186 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:33.389 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:33.501 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:33.758 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 95/134 2022-09-17T10:25:33.865 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 95/134 2022-09-17T10:25:33.974 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 96/134 2022-09-17T10:25:34.074 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:34.362 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 95/134 2022-09-17T10:25:34.461 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 95/134 2022-09-17T10:25:34.595 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 96/134 2022-09-17T10:25:35.835 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:36.429 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:37.128 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 94/134 2022-09-17T10:25:37.407 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 95/134 2022-09-17T10:25:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 95/134 2022-09-17T10:25:37.602 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 96/134 2022-09-17T10:25:52.086 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 96/134 2022-09-17T10:25:52.087 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2022-09-17T10:25:52.087 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2022-09-17T10:25:52.087 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /dev 2022-09-17T10:25:52.087 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /run 2022-09-17T10:25:52.088 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2022-09-17T10:25:52.088 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2022-09-17T10:25:52.088 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2022-09-17T10:25:52.089 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2022-09-17T10:25:52.089 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /dev 2022-09-17T10:25:52.089 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:25:52.171 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 96/134 2022-09-17T10:25:52.172 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /sys 2022-09-17T10:25:52.172 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /proc 2022-09-17T10:25:52.172 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2022-09-17T10:25:52.172 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /run 2022-09-17T10:25:52.173 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /mnt 2022-09-17T10:25:52.173 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /var/tmp 2022-09-17T10:25:52.173 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /home 2022-09-17T10:25:52.173 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /tmp 2022-09-17T10:25:52.174 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2022-09-17T10:25:52.174 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:25:52.490 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 97/134 2022-09-17T10:25:52.600 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 97/134 2022-09-17T10:25:52.947 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 97/134 2022-09-17T10:25:53.027 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 97/134 2022-09-17T10:25:53.134 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 98/134 2022-09-17T10:25:53.267 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 98/134 2022-09-17T10:25:54.707 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 98/134 2022-09-17T10:25:54.740 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 98/134 2022-09-17T10:25:54.839 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 99/134 2022-09-17T10:25:54.862 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 99/134 2022-09-17T10:25:54.908 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 99/134 2022-09-17T10:25:54.931 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 99/134 2022-09-17T10:25:55.344 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 96/134 2022-09-17T10:25:55.344 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2022-09-17T10:25:55.344 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2022-09-17T10:25:55.344 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /dev 2022-09-17T10:25:55.345 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /run 2022-09-17T10:25:55.345 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2022-09-17T10:25:55.345 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2022-09-17T10:25:55.345 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2022-09-17T10:25:55.346 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2022-09-17T10:25:55.346 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /dev 2022-09-17T10:25:55.346 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:25:55.716 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 97/134 2022-09-17T10:25:56.142 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 97/134 2022-09-17T10:25:56.333 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 98/134 2022-09-17T10:25:57.402 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 100/134 2022-09-17T10:25:57.530 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 100/134 2022-09-17T10:25:57.687 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 100/134 2022-09-17T10:25:57.763 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 100/134 2022-09-17T10:25:57.806 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.e 101/134 2022-09-17T10:25:57.814 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 98/134 2022-09-17T10:25:57.894 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.e 101/134 2022-09-17T10:25:57.953 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad. 102/134 2022-09-17T10:25:57.983 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 99/134 2022-09-17T10:25:58.005 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 99/134 2022-09-17T10:25:58.068 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad. 102/134 2022-09-17T10:25:58.159 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 103/134 2022-09-17T10:25:58.246 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 103/134 2022-09-17T10:25:59.114 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 103/134 2022-09-17T10:25:59.268 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 103/134 2022-09-17T10:25:59.374 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 104/134 2022-09-17T10:25:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 104/134 2022-09-17T10:26:00.414 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 104/134 2022-09-17T10:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 100/134 2022-09-17T10:26:00.619 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 104/134 2022-09-17T10:26:00.624 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 105/134 2022-09-17T10:26:00.724 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 105/134 2022-09-17T10:26:00.781 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 100/134 2022-09-17T10:26:00.804 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 105/134 2022-09-17T10:26:00.897 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.e 101/134 2022-09-17T10:26:00.907 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 105/134 2022-09-17T10:26:01.051 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad. 102/134 2022-09-17T10:26:01.124 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el 106/134 2022-09-17T10:26:01.216 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 103/134 2022-09-17T10:26:01.272 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el 106/134 2022-09-17T10:26:01.291 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 107/134 2022-09-17T10:26:01.320 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 107/134 2022-09-17T10:26:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 107/134 2022-09-17T10:26:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 107/134 2022-09-17T10:26:01.532 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 108/134 2022-09-17T10:26:01.544 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 108/134 2022-09-17T10:26:01.620 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 108/134 2022-09-17T10:26:01.633 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 108/134 2022-09-17T10:26:02.184 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 103/134 2022-09-17T10:26:02.435 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 104/134 2022-09-17T10:26:02.588 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 109/134 2022-09-17T10:26:02.727 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 109/134 2022-09-17T10:26:02.759 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 110/134 2022-09-17T10:26:02.856 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 110/134 2022-09-17T10:26:02.921 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 110/134 2022-09-17T10:26:03.000 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 110/134 2022-09-17T10:26:03.049 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-immutable-object-cache-2:16.2.10-818.g9f101 111/134 2022-09-17T10:26:03.093 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.10-818.g9f101 111/134 2022-09-17T10:26:03.154 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:16.2.10-818.g9f101 111/134 2022-09-17T10:26:03.200 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.10-818.g9f101 111/134 2022-09-17T10:26:03.260 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 112/134 2022-09-17T10:26:03.379 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 112/134 2022-09-17T10:26:03.480 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 104/134 2022-09-17T10:26:03.602 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 112/134 2022-09-17T10:26:03.715 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 105/134 2022-09-17T10:26:03.753 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 112/134 2022-09-17T10:26:03.791 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 113/134 2022-09-17T10:26:03.815 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 105/134 2022-09-17T10:26:03.903 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 113/134 2022-09-17T10:26:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el 106/134 2022-09-17T10:26:04.352 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 107/134 2022-09-17T10:26:04.380 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 107/134 2022-09-17T10:26:04.548 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 108/134 2022-09-17T10:26:04.560 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 108/134 2022-09-17T10:26:05.625 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 109/134 2022-09-17T10:26:05.844 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 110/134 2022-09-17T10:26:05.935 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 110/134 2022-09-17T10:26:06.065 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:16.2.10-818.g9f101 111/134 2022-09-17T10:26:06.109 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.10-818.g9f101 111/134 2022-09-17T10:26:06.248 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 112/134 2022-09-17T10:26:06.594 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 112/134 2022-09-17T10:26:06.748 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 113/134 2022-09-17T10:26:08.267 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 113/134 2022-09-17T10:26:08.706 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 113/134 2022-09-17T10:26:09.001 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 114/134 2022-09-17T10:26:09.144 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/134 2022-09-17T10:26:09.254 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 114/134 2022-09-17T10:26:09.588 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 115/134 2022-09-17T10:26:09.784 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 116/134 2022-09-17T10:26:09.924 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/134 2022-09-17T10:26:10.076 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 117/134 2022-09-17T10:26:10.222 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libtool-2.4.6-25.el8.x86_64 118/134 2022-09-17T10:26:10.231 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 116/134 2022-09-17T10:26:10.235 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 118/134 2022-09-17T10:26:10.424 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 117/134 2022-09-17T10:26:10.471 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_ 119/134 2022-09-17T10:26:10.615 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 118/134 2022-09-17T10:26:10.655 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 120/134 2022-09-17T10:26:10.816 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_ 119/134 2022-09-17T10:26:10.842 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 121/134 2022-09-17T10:26:10.987 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 122/134 2022-09-17T10:26:11.017 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 120/134 2022-09-17T10:26:11.155 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 123/134 2022-09-17T10:26:11.243 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 121/134 2022-09-17T10:26:11.247 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 113/134 2022-09-17T10:26:11.363 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 124/134 2022-09-17T10:26:11.416 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 122/134 2022-09-17T10:26:11.570 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 125/134 2022-09-17T10:26:11.578 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 123/134 2022-09-17T10:26:11.761 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 124/134 2022-09-17T10:26:11.830 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flex-2.6.1-9.el8.x86_64 126/134 2022-09-17T10:26:11.915 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 126/134 2022-09-17T10:26:11.925 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 125/134 2022-09-17T10:26:12.088 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 126/134 2022-09-17T10:26:12.138 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : bison-3.0.4-10.el8.x86_64 127/134 2022-09-17T10:26:12.154 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 127/134 2022-09-17T10:26:12.225 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 114/134 2022-09-17T10:26:12.277 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.1-9.el8.x86_64 127/134 2022-09-17T10:26:12.325 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 128/134 2022-09-17T10:26:12.370 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 127/134 2022-09-17T10:26:12.451 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-tui-1:1.30.0-7.el8.x86_64 129/134 2022-09-17T10:26:12.452 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-09-17T10:26:12.548 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 115/134 2022-09-17T10:26:12.573 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.0.4-10.el8.x86_64 128/134 2022-09-17T10:26:12.586 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 128/134 2022-09-17T10:26:12.633 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-09-17T10:26:12.721 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-tui-1:1.30.0-7.el8.x86_64 129/134 2022-09-17T10:26:12.722 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-09-17T10:26:12.766 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-team-1:1.30.0-7.el8.x86_64 131/134 2022-09-17T10:26:12.775 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:12.776 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:12.792 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 116/134 2022-09-17T10:26:12.905 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-09-17T10:26:13.034 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 117/134 2022-09-17T10:26:13.037 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-team-1:1.30.0-7.el8.x86_64 131/134 2022-09-17T10:26:13.047 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:13.048 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:13.176 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:13.176 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-09-17T10:26:13.180 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-25.el8.x86_64 118/134 2022-09-17T10:26:13.193 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 118/134 2022-09-17T10:26:13.419 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_ 119/134 2022-09-17T10:26:13.420 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-09-17T10:26:13.420 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/134 2022-09-17T10:26:13.466 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:13.467 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-09-17T10:26:13.592 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 120/134 2022-09-17T10:26:13.681 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-09-17T10:26:13.681 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/134 2022-09-17T10:26:13.758 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 121/134 2022-09-17T10:26:13.926 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 122/134 2022-09-17T10:26:14.113 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 123/134 2022-09-17T10:26:14.254 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 124/134 2022-09-17T10:26:14.338 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/134 2022-09-17T10:26:14.339 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 1/134 2022-09-17T10:26:14.339 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 2/134 2022-09-17T10:26:14.339 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 3/134 2022-09-17T10:26:14.340 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 4/134 2022-09-17T10:26:14.340 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-immutable-object-cache-2:16.2.10-818.g9f101 5/134 2022-09-17T10:26:14.340 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:26:14.341 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 7/134 2022-09-17T10:26:14.341 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 8/134 2022-09-17T10:26:14.341 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 9/134 2022-09-17T10:26:14.341 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:26:14.342 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 11/134 2022-09-17T10:26:14.342 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 12/134 2022-09-17T10:26:14.342 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:26:14.342 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_ 14/134 2022-09-17T10:26:14.342 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 15/134 2022-09-17T10:26:14.343 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 16/134 2022-09-17T10:26:14.343 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_6 17/134 2022-09-17T10:26:14.343 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 18/134 2022-09-17T10:26:14.343 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 19/134 2022-09-17T10:26:14.344 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el 20/134 2022-09-17T10:26:14.344 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-common-2:16.2.10-818.g9f1013ad.el8. 21/134 2022-09-17T10:26:14.344 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_6 22/134 2022-09-17T10:26:14.344 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 23/134 2022-09-17T10:26:14.345 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 24/134 2022-09-17T10:26:14.345 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 25/134 2022-09-17T10:26:14.345 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 26/134 2022-09-17T10:26:14.345 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 27/134 2022-09-17T10:26:14.345 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 28/134 2022-09-17T10:26:14.346 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad. 29/134 2022-09-17T10:26:14.346 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 30/134 2022-09-17T10:26:14.346 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 31/134 2022-09-17T10:26:14.346 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 32/134 2022-09-17T10:26:14.347 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el 33/134 2022-09-17T10:26:14.347 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 34/134 2022-09-17T10:26:14.347 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.e 35/134 2022-09-17T10:26:14.347 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 36/134 2022-09-17T10:26:14.348 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 37/134 2022-09-17T10:26:14.348 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/134 2022-09-17T10:26:14.348 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/134 2022-09-17T10:26:14.348 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2022-09-17T10:26:14.348 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2022-09-17T10:26:14.349 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/134 2022-09-17T10:26:14.349 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2022-09-17T10:26:14.349 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2022-09-17T10:26:14.349 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2022-09-17T10:26:14.350 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2022-09-17T10:26:14.350 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2022-09-17T10:26:14.350 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2022-09-17T10:26:14.350 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/134 2022-09-17T10:26:14.351 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/134 2022-09-17T10:26:14.351 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/134 2022-09-17T10:26:14.351 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/134 2022-09-17T10:26:14.351 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/134 2022-09-17T10:26:14.351 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/134 2022-09-17T10:26:14.352 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/134 2022-09-17T10:26:14.352 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2022-09-17T10:26:14.352 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2022-09-17T10:26:14.352 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/134 2022-09-17T10:26:14.353 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/134 2022-09-17T10:26:14.353 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/134 2022-09-17T10:26:14.353 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/134 2022-09-17T10:26:14.353 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/134 2022-09-17T10:26:14.354 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/134 2022-09-17T10:26:14.354 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/134 2022-09-17T10:26:14.354 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/134 2022-09-17T10:26:14.354 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/134 2022-09-17T10:26:14.354 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/134 2022-09-17T10:26:14.355 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/134 2022-09-17T10:26:14.355 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/134 2022-09-17T10:26:14.355 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/134 2022-09-17T10:26:14.355 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2022-09-17T10:26:14.356 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 72/134 2022-09-17T10:26:14.356 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/134 2022-09-17T10:26:14.356 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 74/134 2022-09-17T10:26:14.356 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 75/134 2022-09-17T10:26:14.357 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 76/134 2022-09-17T10:26:14.357 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 77/134 2022-09-17T10:26:14.357 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 78/134 2022-09-17T10:26:14.357 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 79/134 2022-09-17T10:26:14.357 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 80/134 2022-09-17T10:26:14.358 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 81/134 2022-09-17T10:26:14.358 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/134 2022-09-17T10:26:14.358 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 83/134 2022-09-17T10:26:14.358 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 84/134 2022-09-17T10:26:14.359 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/134 2022-09-17T10:26:14.359 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 86/134 2022-09-17T10:26:14.359 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 87/134 2022-09-17T10:26:14.359 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 88/134 2022-09-17T10:26:14.360 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/134 2022-09-17T10:26:14.360 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 90/134 2022-09-17T10:26:14.360 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 91/134 2022-09-17T10:26:14.360 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 92/134 2022-09-17T10:26:14.360 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 93/134 2022-09-17T10:26:14.361 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 94/134 2022-09-17T10:26:14.361 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 95/134 2022-09-17T10:26:14.362 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 96/134 2022-09-17T10:26:14.362 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 97/134 2022-09-17T10:26:14.362 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/134 2022-09-17T10:26:14.362 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : bison-3.0.4-10.el8.x86_64 99/134 2022-09-17T10:26:14.363 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/134 2022-09-17T10:26:14.363 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/134 2022-09-17T10:26:14.364 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 102/134 2022-09-17T10:26:14.364 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 103/134 2022-09-17T10:26:14.364 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/134 2022-09-17T10:26:14.364 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 105/134 2022-09-17T10:26:14.364 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 106/134 2022-09-17T10:26:14.365 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 107/134 2022-09-17T10:26:14.365 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 108/134 2022-09-17T10:26:14.365 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 109/134 2022-09-17T10:26:14.365 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 110/134 2022-09-17T10:26:14.366 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2022-09-17T10:26:14.366 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 112/134 2022-09-17T10:26:14.366 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 113/134 2022-09-17T10:26:14.366 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 114/134 2022-09-17T10:26:14.367 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 115/134 2022-09-17T10:26:14.367 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 116/134 2022-09-17T10:26:14.367 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2022-09-17T10:26:14.367 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 118/134 2022-09-17T10:26:14.367 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 119/134 2022-09-17T10:26:14.368 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : jq-1.5-12.el8.x86_64 120/134 2022-09-17T10:26:14.368 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : automake-1.16.1-7.el8.noarch 121/134 2022-09-17T10:26:14.368 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 122/134 2022-09-17T10:26:14.368 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 123/134 2022-09-17T10:26:14.369 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/134 2022-09-17T10:26:14.369 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 125/134 2022-09-17T10:26:14.369 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/134 2022-09-17T10:26:14.369 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 127/134 2022-09-17T10:26:14.370 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-tui-1:1.30.0-7.el8.x86_64 128/134 2022-09-17T10:26:14.370 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-1:1.30.0-13.el8_4.x86_64 129/134 2022-09-17T10:26:14.370 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-1:1.30.0-7.el8.x86_64 130/134 2022-09-17T10:26:14.370 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 131/134 2022-09-17T10:26:14.370 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-team-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:14.371 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 133/134 2022-09-17T10:26:14.429 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 125/134 2022-09-17T10:26:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/134 2022-09-17T10:26:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 1/134 2022-09-17T10:26:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 2/134 2022-09-17T10:26:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 3/134 2022-09-17T10:26:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 4/134 2022-09-17T10:26:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:16.2.10-818.g9f101 5/134 2022-09-17T10:26:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:26:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 7/134 2022-09-17T10:26:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 8/134 2022-09-17T10:26:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 9/134 2022-09-17T10:26:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:26:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 11/134 2022-09-17T10:26:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 12/134 2022-09-17T10:26:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:26:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_ 14/134 2022-09-17T10:26:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 15/134 2022-09-17T10:26:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 16/134 2022-09-17T10:26:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_6 17/134 2022-09-17T10:26:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 18/134 2022-09-17T10:26:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 19/134 2022-09-17T10:26:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el 20/134 2022-09-17T10:26:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:16.2.10-818.g9f1013ad.el8. 21/134 2022-09-17T10:26:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_6 22/134 2022-09-17T10:26:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 23/134 2022-09-17T10:26:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 24/134 2022-09-17T10:26:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 25/134 2022-09-17T10:26:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 26/134 2022-09-17T10:26:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 27/134 2022-09-17T10:26:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 28/134 2022-09-17T10:26:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad. 29/134 2022-09-17T10:26:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 30/134 2022-09-17T10:26:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 31/134 2022-09-17T10:26:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 32/134 2022-09-17T10:26:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el 33/134 2022-09-17T10:26:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 34/134 2022-09-17T10:26:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.e 35/134 2022-09-17T10:26:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 36/134 2022-09-17T10:26:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 37/134 2022-09-17T10:26:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/134 2022-09-17T10:26:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/134 2022-09-17T10:26:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2022-09-17T10:26:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2022-09-17T10:26:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/134 2022-09-17T10:26:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2022-09-17T10:26:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2022-09-17T10:26:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2022-09-17T10:26:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2022-09-17T10:26:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2022-09-17T10:26:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2022-09-17T10:26:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/134 2022-09-17T10:26:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/134 2022-09-17T10:26:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/134 2022-09-17T10:26:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/134 2022-09-17T10:26:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/134 2022-09-17T10:26:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/134 2022-09-17T10:26:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/134 2022-09-17T10:26:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2022-09-17T10:26:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2022-09-17T10:26:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/134 2022-09-17T10:26:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/134 2022-09-17T10:26:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/134 2022-09-17T10:26:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/134 2022-09-17T10:26:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/134 2022-09-17T10:26:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/134 2022-09-17T10:26:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/134 2022-09-17T10:26:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/134 2022-09-17T10:26:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/134 2022-09-17T10:26:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/134 2022-09-17T10:26:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/134 2022-09-17T10:26:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/134 2022-09-17T10:26:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/134 2022-09-17T10:26:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2022-09-17T10:26:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 72/134 2022-09-17T10:26:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 73/134 2022-09-17T10:26:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.0.4-10.el8.x86_64 74/134 2022-09-17T10:26:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/134 2022-09-17T10:26:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 76/134 2022-09-17T10:26:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/134 2022-09-17T10:26:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 78/134 2022-09-17T10:26:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/134 2022-09-17T10:26:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 80/134 2022-09-17T10:26:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/134 2022-09-17T10:26:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 82/134 2022-09-17T10:26:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 83/134 2022-09-17T10:26:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/134 2022-09-17T10:26:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 85/134 2022-09-17T10:26:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/134 2022-09-17T10:26:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 87/134 2022-09-17T10:26:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 88/134 2022-09-17T10:26:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 89/134 2022-09-17T10:26:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 90/134 2022-09-17T10:26:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 91/134 2022-09-17T10:26:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 92/134 2022-09-17T10:26:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 93/134 2022-09-17T10:26:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 94/134 2022-09-17T10:26:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jq-1.5-12.el8.x86_64 95/134 2022-09-17T10:26:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/134 2022-09-17T10:26:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 97/134 2022-09-17T10:26:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 98/134 2022-09-17T10:26:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/134 2022-09-17T10:26:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 100/134 2022-09-17T10:26:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 101/134 2022-09-17T10:26:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 102/134 2022-09-17T10:26:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 103/134 2022-09-17T10:26:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2022-09-17T10:26:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/134 2022-09-17T10:26:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 106/134 2022-09-17T10:26:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/134 2022-09-17T10:26:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/134 2022-09-17T10:26:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 109/134 2022-09-17T10:26:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 110/134 2022-09-17T10:26:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 111/134 2022-09-17T10:26:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 112/134 2022-09-17T10:26:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2022-09-17T10:26:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/134 2022-09-17T10:26:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 115/134 2022-09-17T10:26:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 116/134 2022-09-17T10:26:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 117/134 2022-09-17T10:26:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 118/134 2022-09-17T10:26:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 119/134 2022-09-17T10:26:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 120/134 2022-09-17T10:26:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 121/134 2022-09-17T10:26:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 122/134 2022-09-17T10:26:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 123/134 2022-09-17T10:26:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/134 2022-09-17T10:26:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 125/134 2022-09-17T10:26:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/134 2022-09-17T10:26:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 127/134 2022-09-17T10:26:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.30.0-7.el8.x86_64 128/134 2022-09-17T10:26:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.30.0-13.el8_4.x86_64 129/134 2022-09-17T10:26:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.30.0-7.el8.x86_64 130/134 2022-09-17T10:26:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 131/134 2022-09-17T10:26:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 133/134 2022-09-17T10:26:14.666 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.1-9.el8.x86_64 126/134 2022-09-17T10:26:14.724 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 126/134 2022-09-17T10:26:14.947 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.0.4-10.el8.x86_64 127/134 2022-09-17T10:26:14.960 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 127/134 2022-09-17T10:26:15.106 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 128/134 2022-09-17T10:26:15.240 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.30.0-7.el8.x86_64 129/134 2022-09-17T10:26:15.241 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-09-17T10:26:15.433 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 130/134 2022-09-17T10:26:15.607 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.30.0-7.el8.x86_64 131/134 2022-09-17T10:26:15.616 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:15.618 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:16.035 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:16.035 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-09-17T10:26:16.291 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.30.0-7.el8.x86_64 133/134 2022-09-17T10:26:16.292 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/134 2022-09-17T10:26:16.302 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 134/134 2022-09-17T10:26:16.303 INFO:teuthology.orchestra.run.smithi093.stdout:Installed products updated. 2022-09-17T10:26:16.432 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:16.432 INFO:teuthology.orchestra.run.smithi093.stdout:Upgraded: 2022-09-17T10:26:16.432 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:16.432 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:16.433 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-team-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:16.433 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:16.433 INFO:teuthology.orchestra.run.smithi093.stdout: librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.433 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.434 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2022-09-17T10:26:16.434 INFO:teuthology.orchestra.run.smithi093.stdout: automake-1.16.1-7.el8.noarch 2022-09-17T10:26:16.434 INFO:teuthology.orchestra.run.smithi093.stdout: bison-3.0.4-10.el8.x86_64 2022-09-17T10:26:16.435 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.435 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.435 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.435 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.436 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.437 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.437 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.437 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.437 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.438 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.438 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.438 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.438 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.439 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.439 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.439 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.439 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.440 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.440 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.440 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2022-09-17T10:26:16.440 INFO:teuthology.orchestra.run.smithi093.stdout: flex-2.6.1-9.el8.x86_64 2022-09-17T10:26:16.440 INFO:teuthology.orchestra.run.smithi093.stdout: fuse-2.9.7-12.el8.x86_64 2022-09-17T10:26:16.441 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-17T10:26:16.441 INFO:teuthology.orchestra.run.smithi093.stdout: jq-1.5-12.el8.x86_64 2022-09-17T10:26:16.441 INFO:teuthology.orchestra.run.smithi093.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2022-09-17T10:26:16.441 INFO:teuthology.orchestra.run.smithi093.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2022-09-17T10:26:16.442 INFO:teuthology.orchestra.run.smithi093.stdout: leveldb-1.22-1.el8.x86_64 2022-09-17T10:26:16.442 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-17T10:26:16.442 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.442 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.443 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.443 INFO:teuthology.orchestra.run.smithi093.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2022-09-17T10:26:16.443 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran-8.4.1-1.el8.x86_64 2022-09-17T10:26:16.443 INFO:teuthology.orchestra.run.smithi093.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-17T10:26:16.444 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath-8.4.1-1.el8.x86_64 2022-09-17T10:26:16.444 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-17T10:26:16.444 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.444 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.445 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-09-17T10:26:16.445 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.445 INFO:teuthology.orchestra.run.smithi093.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-09-17T10:26:16.445 INFO:teuthology.orchestra.run.smithi093.stdout: libsepol-devel-2.9-2.el8.x86_64 2022-09-17T10:26:16.446 INFO:teuthology.orchestra.run.smithi093.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-17T10:26:16.446 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-17T10:26:16.446 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2022-09-17T10:26:16.446 INFO:teuthology.orchestra.run.smithi093.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-09-17T10:26:16.447 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-17T10:26:16.447 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-17T10:26:16.447 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-0.3.12-1.el8.x86_64 2022-09-17T10:26:16.447 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-09-17T10:26:16.448 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2022-09-17T10:26:16.448 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-09-17T10:26:16.448 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-09-17T10:26:16.448 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-09-17T10:26:16.449 INFO:teuthology.orchestra.run.smithi093.stdout: python3-apipkg-1.5-6.el8.noarch 2022-09-17T10:26:16.449 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel-2.5.1-5.el8.noarch 2022-09-17T10:26:16.449 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-17T10:26:16.449 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-17T10:26:16.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-17T10:26:16.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-17T10:26:16.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-17T10:26:16.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-17T10:26:16.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-17T10:26:16.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2022-09-17T10:26:16.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-09-17T10:26:16.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-17T10:26:16.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-17T10:26:16.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-17T10:26:16.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2022-09-17T10:26:16.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-17T10:26:16.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-17T10:26:16.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-17T10:26:16.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-17T10:26:16.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-17T10:26:16.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-17T10:26:16.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-17T10:26:16.457 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-17T10:26:16.457 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2022-09-17T10:26:16.457 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2022-09-17T10:26:16.457 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-17T10:26:16.458 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-17T10:26:16.458 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend-2.6-1.el8.noarch 2022-09-17T10:26:16.458 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-17T10:26:16.460 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-17T10:26:16.461 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-17T10:26:16.461 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-17T10:26:16.462 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-17T10:26:16.463 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-17T10:26:16.463 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.464 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.464 INFO:teuthology.orchestra.run.smithi093.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-09-17T10:26:16.465 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-17T10:26:16.465 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-17T10:26:16.466 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.467 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-17T10:26:16.467 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-17T10:26:16.468 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2022-09-17T10:26:16.469 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-17T10:26:16.469 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-17T10:26:16.470 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-17T10:26:16.470 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-17T10:26:16.471 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-17T10:26:16.471 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-17T10:26:16.472 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-17T10:26:16.472 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-17T10:26:16.472 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-17T10:26:16.474 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-17T10:26:16.474 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.474 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.475 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.475 INFO:teuthology.orchestra.run.smithi093.stdout: socat-1.7.3.3-2.el8.x86_64 2022-09-17T10:26:16.475 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2022-09-17T10:26:16.475 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-17T10:26:16.476 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-09-17T10:26:16.476 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:16.476 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2022-09-17T10:26:16.567 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 134/134 2022-09-17T10:26:16.568 INFO:teuthology.orchestra.run.smithi062.stdout:Installed products updated. 2022-09-17T10:26:16.601 DEBUG:teuthology.parallel:result is None 2022-09-17T10:26:16.720 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:16.720 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2022-09-17T10:26:16.720 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:16.721 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:16.721 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:16.721 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:16.721 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.722 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.722 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2022-09-17T10:26:16.722 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.1-7.el8.noarch 2022-09-17T10:26:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.0.4-10.el8.x86_64 2022-09-17T10:26:16.728 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.728 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.729 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.729 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.729 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.730 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.730 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.730 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.732 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.733 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.733 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.733 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.733 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.734 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.734 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.734 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.734 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.735 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.735 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.736 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:16.736 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2022-09-17T10:26:16.736 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.1-9.el8.x86_64 2022-09-17T10:26:16.741 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.7-12.el8.x86_64 2022-09-17T10:26:16.741 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-17T10:26:16.742 INFO:teuthology.orchestra.run.smithi062.stdout: jq-1.5-12.el8.x86_64 2022-09-17T10:26:16.742 INFO:teuthology.orchestra.run.smithi062.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2022-09-17T10:26:16.743 INFO:teuthology.orchestra.run.smithi062.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2022-09-17T10:26:16.743 INFO:teuthology.orchestra.run.smithi062.stdout: leveldb-1.22-1.el8.x86_64 2022-09-17T10:26:16.743 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-17T10:26:16.744 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.744 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.745 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.745 INFO:teuthology.orchestra.run.smithi062.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2022-09-17T10:26:16.746 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-8.4.1-1.el8.x86_64 2022-09-17T10:26:16.746 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-17T10:26:16.748 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-8.4.1-1.el8.x86_64 2022-09-17T10:26:16.748 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-17T10:26:16.748 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.749 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.749 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-09-17T10:26:16.749 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.749 INFO:teuthology.orchestra.run.smithi062.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-09-17T10:26:16.749 INFO:teuthology.orchestra.run.smithi062.stdout: libsepol-devel-2.9-2.el8.x86_64 2022-09-17T10:26:16.750 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-17T10:26:16.750 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-17T10:26:16.750 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2022-09-17T10:26:16.750 INFO:teuthology.orchestra.run.smithi062.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-09-17T10:26:16.751 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-17T10:26:16.751 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-17T10:26:16.751 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.12-1.el8.x86_64 2022-09-17T10:26:16.751 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-09-17T10:26:16.752 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2022-09-17T10:26:16.752 INFO:teuthology.orchestra.run.smithi062.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-09-17T10:26:16.752 INFO:teuthology.orchestra.run.smithi062.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-09-17T10:26:16.752 INFO:teuthology.orchestra.run.smithi062.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-09-17T10:26:16.753 INFO:teuthology.orchestra.run.smithi062.stdout: python3-apipkg-1.5-6.el8.noarch 2022-09-17T10:26:16.753 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.5.1-5.el8.noarch 2022-09-17T10:26:16.753 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-17T10:26:16.753 INFO:teuthology.orchestra.run.smithi062.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-17T10:26:16.753 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-17T10:26:16.754 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.754 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.754 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.754 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-17T10:26:16.755 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-17T10:26:16.755 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-17T10:26:16.755 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-17T10:26:16.755 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2022-09-17T10:26:16.755 INFO:teuthology.orchestra.run.smithi062.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-09-17T10:26:16.756 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-17T10:26:16.756 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-17T10:26:16.756 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-17T10:26:16.756 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2022-09-17T10:26:16.757 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-17T10:26:16.757 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-17T10:26:16.757 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-17T10:26:16.757 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-17T10:26:16.758 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-17T10:26:16.758 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-17T10:26:16.758 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-17T10:26:16.758 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-17T10:26:16.758 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2022-09-17T10:26:16.759 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2022-09-17T10:26:16.759 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-17T10:26:16.759 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-17T10:26:16.759 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-2.6-1.el8.noarch 2022-09-17T10:26:16.760 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-17T10:26:16.760 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-17T10:26:16.760 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-17T10:26:16.760 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-17T10:26:16.761 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-17T10:26:16.761 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-17T10:26:16.761 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.761 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.761 INFO:teuthology.orchestra.run.smithi062.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-09-17T10:26:16.762 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-17T10:26:16.762 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-17T10:26:16.762 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.762 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-17T10:26:16.763 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-17T10:26:16.763 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2022-09-17T10:26:16.763 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-17T10:26:16.763 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-17T10:26:16.763 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-17T10:26:16.764 INFO:teuthology.orchestra.run.smithi062.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-17T10:26:16.764 INFO:teuthology.orchestra.run.smithi062.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-17T10:26:16.764 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-17T10:26:16.764 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-17T10:26:16.765 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-17T10:26:16.765 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-17T10:26:16.765 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-17T10:26:16.765 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.765 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.766 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:16.766 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.3.3-2.el8.x86_64 2022-09-17T10:26:16.766 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2022-09-17T10:26:16.766 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-17T10:26:16.767 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-09-17T10:26:16.767 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:16.767 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2022-09-17T10:26:16.899 DEBUG:teuthology.parallel:result is None 2022-09-17T10:26:17.144 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/134 2022-09-17T10:26:17.145 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 1/134 2022-09-17T10:26:17.145 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 2/134 2022-09-17T10:26:17.145 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 3/134 2022-09-17T10:26:17.145 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 4/134 2022-09-17T10:26:17.145 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:16.2.10-818.g9f101 5/134 2022-09-17T10:26:17.146 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 6/134 2022-09-17T10:26:17.146 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 7/134 2022-09-17T10:26:17.146 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 8/134 2022-09-17T10:26:17.146 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 9/134 2022-09-17T10:26:17.147 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 10/134 2022-09-17T10:26:17.147 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 11/134 2022-09-17T10:26:17.147 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 12/134 2022-09-17T10:26:17.147 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 13/134 2022-09-17T10:26:17.148 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_ 14/134 2022-09-17T10:26:17.148 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 15/134 2022-09-17T10:26:17.148 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 16/134 2022-09-17T10:26:17.148 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_6 17/134 2022-09-17T10:26:17.148 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86 18/134 2022-09-17T10:26:17.149 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 19/134 2022-09-17T10:26:17.149 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el 20/134 2022-09-17T10:26:17.149 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:16.2.10-818.g9f1013ad.el8. 21/134 2022-09-17T10:26:17.149 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_6 22/134 2022-09-17T10:26:17.150 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 23/134 2022-09-17T10:26:17.150 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 24/134 2022-09-17T10:26:17.151 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 25/134 2022-09-17T10:26:17.151 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 26/134 2022-09-17T10:26:17.151 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 27/134 2022-09-17T10:26:17.151 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 28/134 2022-09-17T10:26:17.152 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad. 29/134 2022-09-17T10:26:17.152 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noa 30/134 2022-09-17T10:26:17.152 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.n 31/134 2022-09-17T10:26:17.152 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1 32/134 2022-09-17T10:26:17.152 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el 33/134 2022-09-17T10:26:17.153 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 34/134 2022-09-17T10:26:17.153 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.e 35/134 2022-09-17T10:26:17.153 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 36/134 2022-09-17T10:26:17.153 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 37/134 2022-09-17T10:26:17.154 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/134 2022-09-17T10:26:17.154 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/134 2022-09-17T10:26:17.154 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2022-09-17T10:26:17.154 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2022-09-17T10:26:17.155 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/134 2022-09-17T10:26:17.155 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2022-09-17T10:26:17.155 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2022-09-17T10:26:17.155 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2022-09-17T10:26:17.155 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2022-09-17T10:26:17.156 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2022-09-17T10:26:17.156 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2022-09-17T10:26:17.156 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/134 2022-09-17T10:26:17.156 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/134 2022-09-17T10:26:17.157 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/134 2022-09-17T10:26:17.157 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/134 2022-09-17T10:26:17.157 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/134 2022-09-17T10:26:17.157 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/134 2022-09-17T10:26:17.157 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/134 2022-09-17T10:26:17.158 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2022-09-17T10:26:17.158 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2022-09-17T10:26:17.158 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/134 2022-09-17T10:26:17.158 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/134 2022-09-17T10:26:17.159 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/134 2022-09-17T10:26:17.159 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/134 2022-09-17T10:26:17.159 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/134 2022-09-17T10:26:17.159 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/134 2022-09-17T10:26:17.160 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/134 2022-09-17T10:26:17.160 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/134 2022-09-17T10:26:17.160 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/134 2022-09-17T10:26:17.160 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/134 2022-09-17T10:26:17.160 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/134 2022-09-17T10:26:17.161 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/134 2022-09-17T10:26:17.161 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/134 2022-09-17T10:26:17.161 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2022-09-17T10:26:17.161 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 72/134 2022-09-17T10:26:17.162 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/134 2022-09-17T10:26:17.162 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 74/134 2022-09-17T10:26:17.162 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 75/134 2022-09-17T10:26:17.162 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 76/134 2022-09-17T10:26:17.163 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 77/134 2022-09-17T10:26:17.163 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 78/134 2022-09-17T10:26:17.163 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 79/134 2022-09-17T10:26:17.164 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 80/134 2022-09-17T10:26:17.164 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 81/134 2022-09-17T10:26:17.164 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/134 2022-09-17T10:26:17.164 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 83/134 2022-09-17T10:26:17.165 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 84/134 2022-09-17T10:26:17.165 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/134 2022-09-17T10:26:17.165 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 86/134 2022-09-17T10:26:17.166 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 87/134 2022-09-17T10:26:17.166 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 88/134 2022-09-17T10:26:17.166 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/134 2022-09-17T10:26:17.166 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 90/134 2022-09-17T10:26:17.166 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 91/134 2022-09-17T10:26:17.167 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 92/134 2022-09-17T10:26:17.167 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 93/134 2022-09-17T10:26:17.167 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 94/134 2022-09-17T10:26:17.167 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 95/134 2022-09-17T10:26:17.168 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 96/134 2022-09-17T10:26:17.168 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 97/134 2022-09-17T10:26:17.168 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/134 2022-09-17T10:26:17.168 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.0.4-10.el8.x86_64 99/134 2022-09-17T10:26:17.168 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/134 2022-09-17T10:26:17.169 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/134 2022-09-17T10:26:17.169 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 102/134 2022-09-17T10:26:17.169 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 103/134 2022-09-17T10:26:17.169 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/134 2022-09-17T10:26:17.170 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 105/134 2022-09-17T10:26:17.170 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 106/134 2022-09-17T10:26:17.170 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 107/134 2022-09-17T10:26:17.170 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 108/134 2022-09-17T10:26:17.171 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 109/134 2022-09-17T10:26:17.171 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 110/134 2022-09-17T10:26:17.171 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2022-09-17T10:26:17.171 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 112/134 2022-09-17T10:26:17.172 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 113/134 2022-09-17T10:26:17.172 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 114/134 2022-09-17T10:26:17.172 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 115/134 2022-09-17T10:26:17.172 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 116/134 2022-09-17T10:26:17.172 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2022-09-17T10:26:17.173 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 118/134 2022-09-17T10:26:17.173 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 119/134 2022-09-17T10:26:17.173 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jq-1.5-12.el8.x86_64 120/134 2022-09-17T10:26:17.173 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.1-7.el8.noarch 121/134 2022-09-17T10:26:17.174 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 122/134 2022-09-17T10:26:17.174 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 123/134 2022-09-17T10:26:17.174 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/134 2022-09-17T10:26:17.174 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 125/134 2022-09-17T10:26:17.175 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/134 2022-09-17T10:26:17.175 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 127/134 2022-09-17T10:26:17.176 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.30.0-7.el8.x86_64 128/134 2022-09-17T10:26:17.176 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.30.0-13.el8_4.x86_64 129/134 2022-09-17T10:26:17.176 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.30.0-7.el8.x86_64 130/134 2022-09-17T10:26:17.177 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.30.0-13.el8_4.x86_64 131/134 2022-09-17T10:26:17.177 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.30.0-7.el8.x86_64 132/134 2022-09-17T10:26:17.177 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 133/134 2022-09-17T10:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.30.0-7.el8.x86_64 134/134 2022-09-17T10:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout:Installed products updated. 2022-09-17T10:26:19.285 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:19.285 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2022-09-17T10:26:19.286 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:19.286 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:19.287 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:19.287 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.30.0-13.el8_4.x86_64 2022-09-17T10:26:19.288 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.288 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.288 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2022-09-17T10:26:19.289 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.1-7.el8.noarch 2022-09-17T10:26:19.289 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.0.4-10.el8.x86_64 2022-09-17T10:26:19.290 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.290 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.292 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.292 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.292 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.292 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.293 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.293 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.293 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.293 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.294 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.294 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.294 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.295 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.295 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.295 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.295 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.296 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:16.2.10-818.g9f1013ad.el8.noarch 2022-09-17T10:26:19.296 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2022-09-17T10:26:19.296 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.1-9.el8.x86_64 2022-09-17T10:26:19.296 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.7-12.el8.x86_64 2022-09-17T10:26:19.297 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-17T10:26:19.297 INFO:teuthology.orchestra.run.smithi159.stdout: jq-1.5-12.el8.x86_64 2022-09-17T10:26:19.297 INFO:teuthology.orchestra.run.smithi159.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2022-09-17T10:26:19.297 INFO:teuthology.orchestra.run.smithi159.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2022-09-17T10:26:19.297 INFO:teuthology.orchestra.run.smithi159.stdout: leveldb-1.22-1.el8.x86_64 2022-09-17T10:26:19.298 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-17T10:26:19.299 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.299 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.299 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.299 INFO:teuthology.orchestra.run.smithi159.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2022-09-17T10:26:19.300 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-8.4.1-1.el8.x86_64 2022-09-17T10:26:19.300 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-17T10:26:19.300 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-8.4.1-1.el8.x86_64 2022-09-17T10:26:19.300 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-17T10:26:19.301 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.301 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.301 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-09-17T10:26:19.301 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.302 INFO:teuthology.orchestra.run.smithi159.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-09-17T10:26:19.302 INFO:teuthology.orchestra.run.smithi159.stdout: libsepol-devel-2.9-2.el8.x86_64 2022-09-17T10:26:19.302 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-17T10:26:19.303 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-17T10:26:19.303 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2022-09-17T10:26:19.303 INFO:teuthology.orchestra.run.smithi159.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-09-17T10:26:19.303 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-17T10:26:19.304 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-17T10:26:19.304 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.12-1.el8.x86_64 2022-09-17T10:26:19.304 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-09-17T10:26:19.305 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2022-09-17T10:26:19.305 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-09-17T10:26:19.305 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-09-17T10:26:19.305 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-09-17T10:26:19.306 INFO:teuthology.orchestra.run.smithi159.stdout: python3-apipkg-1.5-6.el8.noarch 2022-09-17T10:26:19.306 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.5.1-5.el8.noarch 2022-09-17T10:26:19.307 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-17T10:26:19.307 INFO:teuthology.orchestra.run.smithi159.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-17T10:26:19.307 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-17T10:26:19.308 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.308 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.309 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.309 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-17T10:26:19.309 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-17T10:26:19.310 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-17T10:26:19.310 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-17T10:26:19.310 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2022-09-17T10:26:19.311 INFO:teuthology.orchestra.run.smithi159.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-09-17T10:26:19.311 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-17T10:26:19.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-17T10:26:19.312 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-17T10:26:19.314 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2022-09-17T10:26:19.314 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-17T10:26:19.315 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-17T10:26:19.315 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-17T10:26:19.315 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-17T10:26:19.315 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-17T10:26:19.316 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-17T10:26:19.316 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-17T10:26:19.316 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-17T10:26:19.317 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2022-09-17T10:26:19.317 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2022-09-17T10:26:19.317 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-17T10:26:19.317 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-17T10:26:19.318 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-2.6-1.el8.noarch 2022-09-17T10:26:19.318 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-17T10:26:19.318 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-17T10:26:19.318 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-17T10:26:19.319 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-17T10:26:19.319 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-17T10:26:19.319 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-17T10:26:19.319 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.320 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.320 INFO:teuthology.orchestra.run.smithi159.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-09-17T10:26:19.320 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-17T10:26:19.321 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-17T10:26:19.321 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.321 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-17T10:26:19.321 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-17T10:26:19.322 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2022-09-17T10:26:19.322 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-17T10:26:19.322 INFO:teuthology.orchestra.run.smithi159.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-17T10:26:19.322 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-17T10:26:19.323 INFO:teuthology.orchestra.run.smithi159.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-17T10:26:19.323 INFO:teuthology.orchestra.run.smithi159.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-17T10:26:19.324 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-17T10:26:19.324 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-17T10:26:19.325 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-17T10:26:19.325 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-17T10:26:19.326 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-17T10:26:19.326 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.327 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.327 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:16.2.10-818.g9f1013ad.el8.x86_64 2022-09-17T10:26:19.328 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.3.3-2.el8.x86_64 2022-09-17T10:26:19.328 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2022-09-17T10:26:19.329 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-17T10:26:19.329 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-09-17T10:26:19.330 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:19.330 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2022-09-17T10:26:19.477 DEBUG:teuthology.parallel:result is None 2022-09-17T10:26:19.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2022-09-17T10:26:19.564 INFO:teuthology.orchestra.run.smithi062.stdout:RedHatEnterprise 2022-09-17T10:26:19.565 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:26:19.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:26:20.148 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-17T10:26:20.179 INFO:teuthology.orchestra.run.smithi062.stdout:16.2.10-818.g9f1013ad.el8 2022-09-17T10:26:20.181 INFO:teuthology.packaging:The installed version of ceph is 16.2.10-818.g9f1013ad.el8 2022-09-17T10:26:20.192 INFO:teuthology.task.install:The correct ceph version 16.2.10-818.g9f1013ad is installed. 2022-09-17T10:26:20.193 DEBUG:teuthology.orchestra.run.smithi093:> sudo lsb_release -is 2022-09-17T10:26:20.263 INFO:teuthology.orchestra.run.smithi093.stdout:RedHatEnterprise 2022-09-17T10:26:20.266 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:26:20.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:26:20.605 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-17T10:26:20.632 INFO:teuthology.orchestra.run.smithi093.stdout:16.2.10-818.g9f1013ad.el8 2022-09-17T10:26:20.641 INFO:teuthology.packaging:The installed version of ceph is 16.2.10-818.g9f1013ad.el8 2022-09-17T10:26:20.641 INFO:teuthology.task.install:The correct ceph version 16.2.10-818.g9f1013ad is installed. 2022-09-17T10:26:20.642 DEBUG:teuthology.orchestra.run.smithi159:> sudo lsb_release -is 2022-09-17T10:26:20.694 INFO:teuthology.orchestra.run.smithi159.stdout:RedHatEnterprise 2022-09-17T10:26:20.695 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-17T10:26:20.696 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:26:22.202 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-17T10:26:22.227 INFO:teuthology.orchestra.run.smithi159.stdout:16.2.10-818.g9f1013ad.el8 2022-09-17T10:26:22.228 INFO:teuthology.packaging:The installed version of ceph is 16.2.10-818.g9f1013ad.el8 2022-09-17T10:26:22.228 INFO:teuthology.task.install:The correct ceph version 16.2.10-818.g9f1013ad is installed. 2022-09-17T10:26:22.228 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-09-17T10:26:22.229 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:22.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-17T10:26:22.260 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:26:22.261 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-17T10:26:22.292 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:26:22.293 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-17T10:26:22.325 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-09-17T10:26:22.325 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:22.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2022-09-17T10:26:22.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-17T10:26:22.424 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:26:22.425 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2022-09-17T10:26:22.458 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-17T10:26:22.540 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:26:22.541 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2022-09-17T10:26:22.581 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-17T10:26:22.651 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-09-17T10:26:22.652 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:22.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-17T10:26:22.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-17T10:26:22.752 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:26:22.753 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-17T10:26:22.792 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-17T10:26:22.862 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:26:22.863 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-17T10:26:22.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-17T10:26:22.960 INFO:teuthology.run_tasks:Running task ceph... 2022-09-17T10:26:23.040 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-09-17T10:26:23.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2022-09-17T10:26:23.046 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 777 /var/log/ceph 2022-09-17T10:26:23.050 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /var/log/ceph 2022-09-17T10:26:23.079 INFO:tasks.ceph:Disabling ceph logrotate... 2022-09-17T10:26:23.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2022-09-17T10:26:23.116 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/logrotate.d/ceph 2022-09-17T10:26:23.121 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/logrotate.d/ceph 2022-09-17T10:26:23.148 INFO:tasks.ceph:Creating extra log directories... 2022-09-17T10:26:23.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-09-17T10:26:23.186 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-09-17T10:26:23.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-09-17T10:26:23.231 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-09-17T10:26:23.231 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-09-17T10:26:23.232 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-09-17T10:26:23.232 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:23.233 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-09-17T10:26:23.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:23.411 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:23.443 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:26:23.443 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-09-17T10:26:23.464 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:23.592 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:23.619 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:26:23.619 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-09-17T10:26:23.636 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:23.750 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:23.786 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-09-17T10:26:23.787 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-09-17T10:26:23.787 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi/7030120', 'branch': 'pacific', 'description': 'fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '7030120', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2022-09-13_04:17:04-fs-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'pacific'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7'}}, 'kclient': {'mntopts': ['nowsync']}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'pacific', 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 500, 'repo': 'git://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'pacific', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_9f1013ad23aaca59f081f4d35bc048be3d0598b7/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'suite_sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7', 'targets': {'smithi062.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxz0JUOMtlMwzFlHzdrV7GrJ1WN+yORXfLJJUwmYxTbRJNwKSFx79gtmHwjGsIngx7DTyEINMCV0jJ+VrsZtMuepuvlAFIZ1fwgs72PZeOl9j8QJpJx6hoORYYRwWSR1VHqfXoTIZQeJ4xn1huS72UVkMn9gD3Uxkbuz+HmQTOdI4VcZLeLLUIlcn/xhYjO6hyMYHpSbWxilW6L3VuEIEBMso/Dhai26KB1DT99L6+5cO0q97IjCi2YG0MynDfw+/g1lePdNX6QKgeaVFEeOk/0Xt1wlJkce34wfoicqp682/5tNFKrp2ogh7CCR1ATHVn9pm0dFKjpCME3e1jwNAFOMh3OYAI7Acc+U96zTH8FXdkWVM+XRrJYOw2M7W+fxkWK2exYEPhvVJ7VGdUZYjU6sp675BaMfs5pwxszSalVjVsOF61uwk1KRfik/tR41N2qmqmGMsUllXmzNTDX7KOjO3rqweRwQ8MqtS+Qi5vL6o1naIIsePCSCB7/4vGSyk=', 'smithi093.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC++6dg173hSv4S6r4QMmDbF+nmRacVQoAHxIgOUv9R8QsVHKG3DmhgPJB5B3EtJ93j76wnCZOKOOd//KMNJ51tAft0Gu0vZOAyvIZkRQyYlUUIZ1KIPnxYZ4N+ybAsJajMdmnnfNMBeoHQ568b4dGoO6xl2hZEhmv+z09l2P5iZpF4a0NsBt1+BCa63wlwcZb8eJFswPxDo0hk27d9VLmg0w2LjAwlib9zHkOkwMrEx/ESsOaZdH+tQ4RgUXYybkzDkjnQX29c3gzrL+40Ml/MHot7Od/wvTUWjPgs9V0W62TxJrEZ8QyYr6J6aaX/0SO0D3XzYz84rmICUTP2nGT2sKQv0IRa1OvRtBjC4GX/QMY15qojy7QXp1VTayMd8OxGSJjGhAMBsoqU1FPFSdXeR+s/xDytEpFlENnfNXJB0LJ4CpwNtnq5xHF+5vNE3vw3tXxq1yONBgrn3KsmvWqoe/MXDuAOyVeOe4RqE23/xKDg+U8Jud/6soIKtbHNkAk=', 'smithi159.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuGVEdNCo+VXOeCsmzBgKIG1HsqkdQx1SMsfclLCoyFBNGQr66KL7dLiHfW00dRNVAFVm9qoDwqySyAUsOZr6szhFMOuh/GtcfeUXVa05OeAPukUVbzTjdk0cDqlZ7AlLJHQ76NfWx4HmNmVorf57tQZkVvmchYCf91fHacjZbHhkk9BjE2T2b5VHzzQZ4uXG5N9O8WmmHfcC2fbCyr+b3FBJF4nKC9UTndghUgzS+iuGtUytwdb1Q/BG0Mmr7WFQmWEIA0XNJjF/ZwN/BsXPulwMqMyO9O822BbHCy/IDLKWEpiHGNcFuOqFN1OQU62RusQcBR045d+fh84WYzDQSL9eHIjBiIjDPg8AyicQBBqQW+uFMDL/+QzHA7vHdpA7eN2/VzKbHDrmMdAoCXjk3ahKWs7QHWr4f+gRUL6w34Dv6SeRnR3L47EWeTO6SZ7qLkrAnQ7Co8fCUcCbaio4lObrNFPaTvnSP2pGvqEWESvxBROM5AJCLBtiJ+a8NHt0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9f1013ad23aaca59f081f4d35bc048be3d0598b7'}}, {'ceph': None}, {'kclient': None}, {'check-counter': {}}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b58f2c18636eb10faa77ed3614abd00cb85dfc2c', 'timestamp': '2022-09-13_04:17:04', 'tube': 'smithi', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.14413'} 2022-09-17T10:26:23.789 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-09-17T10:26:23.792 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-09-17T10:26:23.795 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-09-17T10:26:23.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2022-09-17T10:26:23.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/run/ceph 2022-09-17T10:26:23.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/run/ceph 2022-09-17T10:26:23.900 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:23.901 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2022-09-17T10:26:23.948 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-17T10:26:23.950 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-17T10:26:24.005 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-17T10:26:24.005 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.006 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 198776 Links: 1 2022-09-17T10:26:24.006 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.008 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.009 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2022-09-17 10:26:14.161935253 +0000 2022-09-17T10:26:24.009 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2022-09-17 10:23:37.587386096 +0000 2022-09-17T10:26:24.010 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2022-09-17 10:23:37.587386096 +0000 2022-09-17T10:26:24.010 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2022-09-17T10:26:24.017 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2022-09-17T10:26:24.017 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2022-09-17T10:26:24.017 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000260425 s, 2.0 MB/s 2022-09-17T10:26:24.020 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-17T10:26:24.080 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-17T10:26:24.081 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.081 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 191818 Links: 1 2022-09-17T10:26:24.082 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.082 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.082 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2022-09-17 10:26:14.161935253 +0000 2022-09-17T10:26:24.082 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2022-09-17 10:23:38.120377407 +0000 2022-09-17T10:26:24.083 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2022-09-17 10:23:38.120377407 +0000 2022-09-17T10:26:24.083 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2022-09-17T10:26:24.093 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2022-09-17T10:26:24.093 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2022-09-17T10:26:24.094 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000221989 s, 2.3 MB/s 2022-09-17T10:26:24.096 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-17T10:26:24.153 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-17T10:26:24.154 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.154 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 196608 Links: 1 2022-09-17T10:26:24.154 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.155 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.155 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2022-09-17 10:26:14.162935237 +0000 2022-09-17T10:26:24.155 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2022-09-17 10:23:38.695367996 +0000 2022-09-17T10:26:24.155 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2022-09-17 10:23:38.695367996 +0000 2022-09-17T10:26:24.156 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2022-09-17T10:26:24.166 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2022-09-17T10:26:24.166 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2022-09-17T10:26:24.166 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000217794 s, 2.4 MB/s 2022-09-17T10:26:24.168 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-17T10:26:24.239 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-17T10:26:24.239 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.240 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 195145 Links: 1 2022-09-17T10:26:24.240 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.240 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.240 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2022-09-17 10:26:14.162935237 +0000 2022-09-17T10:26:24.240 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2022-09-17 10:23:39.247358959 +0000 2022-09-17T10:26:24.241 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2022-09-17 10:23:39.247358959 +0000 2022-09-17T10:26:24.241 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2022-09-17T10:26:24.256 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2022-09-17T10:26:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2022-09-17T10:26:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000240275 s, 2.1 MB/s 2022-09-17T10:26:24.257 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:24.258 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:26:24.259 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2022-09-17T10:26:24.292 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-17T10:26:24.293 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-17T10:26:24.354 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-17T10:26:24.355 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.357 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 198151 Links: 1 2022-09-17T10:26:24.357 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.358 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.358 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2022-09-17 10:26:13.915036060 +0000 2022-09-17T10:26:24.359 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2022-09-17 10:23:35.636518156 +0000 2022-09-17T10:26:24.359 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2022-09-17 10:23:35.636518156 +0000 2022-09-17T10:26:24.359 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2022-09-17T10:26:24.364 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2022-09-17T10:26:24.365 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2022-09-17T10:26:24.365 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000260853 s, 2.0 MB/s 2022-09-17T10:26:24.369 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-17T10:26:24.428 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-17T10:26:24.428 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.429 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 197546 Links: 1 2022-09-17T10:26:24.429 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.429 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.430 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2022-09-17 10:26:13.915036060 +0000 2022-09-17T10:26:24.430 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2022-09-17 10:23:36.202506475 +0000 2022-09-17T10:26:24.430 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2022-09-17 10:23:36.202506475 +0000 2022-09-17T10:26:24.431 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2022-09-17T10:26:24.439 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2022-09-17T10:26:24.439 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2022-09-17T10:26:24.439 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000215839 s, 2.4 MB/s 2022-09-17T10:26:24.442 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-17T10:26:24.499 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-17T10:26:24.500 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.500 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 199382 Links: 1 2022-09-17T10:26:24.501 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.502 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.502 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2022-09-17 10:26:13.915036060 +0000 2022-09-17T10:26:24.502 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2022-09-17 10:23:36.744495289 +0000 2022-09-17T10:26:24.503 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2022-09-17 10:23:36.744495289 +0000 2022-09-17T10:26:24.503 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2022-09-17T10:26:24.507 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2022-09-17T10:26:24.508 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2022-09-17T10:26:24.508 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000215165 s, 2.4 MB/s 2022-09-17T10:26:24.510 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-17T10:26:24.566 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-17T10:26:24.566 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.567 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 199475 Links: 1 2022-09-17T10:26:24.567 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.567 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.567 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2022-09-17 10:26:13.915036060 +0000 2022-09-17T10:26:24.568 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2022-09-17 10:23:37.311483587 +0000 2022-09-17T10:26:24.568 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2022-09-17 10:23:37.311483587 +0000 2022-09-17T10:26:24.568 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2022-09-17T10:26:24.580 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2022-09-17T10:26:24.581 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2022-09-17T10:26:24.581 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000233346 s, 2.2 MB/s 2022-09-17T10:26:24.582 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:24.583 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:26:24.583 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2022-09-17T10:26:24.610 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-17T10:26:24.611 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-17T10:26:24.665 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-17T10:26:24.666 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.666 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d Inode: 195239 Links: 1 2022-09-17T10:26:24.666 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.667 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.667 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2022-09-17 10:26:16.728062719 +0000 2022-09-17T10:26:24.667 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-09-17 10:23:35.684777595 +0000 2022-09-17T10:26:24.667 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-09-17 10:23:35.684777595 +0000 2022-09-17T10:26:24.668 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-09-17T10:26:24.677 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2022-09-17T10:26:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2022-09-17T10:26:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000253289 s, 2.0 MB/s 2022-09-17T10:26:24.684 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-17T10:26:24.740 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-17T10:26:24.741 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.741 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d Inode: 196812 Links: 1 2022-09-17T10:26:24.741 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.741 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.742 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2022-09-17 10:26:16.729062716 +0000 2022-09-17T10:26:24.742 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-09-17 10:23:36.235776098 +0000 2022-09-17T10:26:24.742 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-09-17 10:23:36.235776098 +0000 2022-09-17T10:26:24.743 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-09-17T10:26:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2022-09-17T10:26:24.751 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2022-09-17T10:26:24.751 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000227432 s, 2.3 MB/s 2022-09-17T10:26:24.753 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-17T10:26:24.808 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-17T10:26:24.809 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.809 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d Inode: 196852 Links: 1 2022-09-17T10:26:24.809 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.809 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.810 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2022-09-17 10:26:16.729062716 +0000 2022-09-17T10:26:24.810 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-09-17 10:23:36.777774625 +0000 2022-09-17T10:26:24.811 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-09-17 10:23:36.777774625 +0000 2022-09-17T10:26:24.811 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-09-17T10:26:24.818 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2022-09-17T10:26:24.819 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2022-09-17T10:26:24.819 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000204564 s, 2.5 MB/s 2022-09-17T10:26:24.821 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-17T10:26:24.883 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-17T10:26:24.883 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-17T10:26:24.883 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d Inode: 199701 Links: 1 2022-09-17T10:26:24.883 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:26:24.884 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2022-09-17T10:26:24.884 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2022-09-17 10:26:16.729062716 +0000 2022-09-17T10:26:24.884 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2022-09-17 10:23:37.344773084 +0000 2022-09-17T10:26:24.884 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2022-09-17 10:23:37.344773084 +0000 2022-09-17T10:26:24.885 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2022-09-17T10:26:24.893 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2022-09-17T10:26:24.894 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2022-09-17T10:26:24.895 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000231195 s, 2.2 MB/s 2022-09-17T10:26:24.897 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:24.897 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2022-09-17T10:26:24.898 INFO:tasks.ceph:Generating config... 2022-09-17T10:26:24.901 INFO:tasks.ceph:[client] client mount timeout = 600 2022-09-17T10:26:24.902 INFO:tasks.ceph:[client] debug client = 20 2022-09-17T10:26:24.902 INFO:tasks.ceph:[client] debug ms = 1 2022-09-17T10:26:24.903 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-09-17T10:26:24.903 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-09-17T10:26:24.903 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-09-17T10:26:24.904 INFO:tasks.ceph:[mds] debug mds = 20 2022-09-17T10:26:24.904 INFO:tasks.ceph:[mds] debug ms = 1 2022-09-17T10:26:24.904 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2022-09-17T10:26:24.904 INFO:tasks.ceph:[mds] mds bal merge size = 5 2022-09-17T10:26:24.905 INFO:tasks.ceph:[mds] mds bal split bits = 3 2022-09-17T10:26:24.905 INFO:tasks.ceph:[mds] mds bal split size = 100 2022-09-17T10:26:24.906 INFO:tasks.ceph:[mds] mds debug frag = True 2022-09-17T10:26:24.907 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-09-17T10:26:24.907 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-09-17T10:26:24.908 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-09-17T10:26:24.908 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-09-17T10:26:24.909 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-09-17T10:26:24.909 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-09-17T10:26:24.910 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-09-17T10:26:24.910 INFO:tasks.ceph:[mgr] debug ms = 1 2022-09-17T10:26:24.911 INFO:tasks.ceph:[mon] debug mon = 20 2022-09-17T10:26:24.911 INFO:tasks.ceph:[mon] debug ms = 1 2022-09-17T10:26:24.912 INFO:tasks.ceph:[mon] debug paxos = 20 2022-09-17T10:26:24.913 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-09-17T10:26:24.913 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-09-17T10:26:24.914 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2022-09-17T10:26:24.914 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-09-17T10:26:24.915 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-09-17T10:26:24.916 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-09-17T10:26:24.916 INFO:tasks.ceph:[osd] debug ms = 1 2022-09-17T10:26:24.917 INFO:tasks.ceph:[osd] debug osd = 20 2022-09-17T10:26:24.917 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-09-17T10:26:24.918 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-09-17T10:26:24.918 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-09-17T10:26:24.919 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-09-17T10:26:24.920 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-09-17T10:26:24.921 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-09-17T10:26:24.921 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-09-17T10:26:24.921 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2022-09-17T10:26:24.921 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2022-09-17T10:26:24.922 INFO:tasks.ceph:Setting up mon.a... 2022-09-17T10:26:24.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-09-17T10:26:24.979 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2022-09-17T10:26:24.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-09-17T10:26:25.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-17T10:26:25.095 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.b', '172.21.15.93'), ('mon.c', '172.21.15.159')] 2022-09-17T10:26:25.097 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,172.21.15.93,172.21.15.159', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.d': {}, 'mds.g': {}, 'mds.j': {}, 'mds.b': {}, 'mds.e': {}, 'mds.h': {}, 'mds.k': {}, 'mds.c': {}, 'mds.f': {}, 'mds.i': {}, 'mds.l': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-09-17T10:26:25.102 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:25.103 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-09-17T10:26:25.157 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --add b 172.21.15.93 --add c 172.21.15.159 --print /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:25.242 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:25.243 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid caff66e9-e5bf-4b11-8278-68b3c904b131 2022-09-17T10:26:25.243 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2022-09-17T10:26:25.243 INFO:teuthology.orchestra.run.smithi062.stdout:fsid caff66e9-e5bf-4b11-8278-68b3c904b131 2022-09-17T10:26:25.244 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2022-09-17T10:26:25.238509+0000 2022-09-17T10:26:25.244 INFO:teuthology.orchestra.run.smithi062.stdout:created 2022-09-17T10:26:25.238509+0000 2022-09-17T10:26:25.245 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 0 (unknown) 2022-09-17T10:26:25.245 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2022-09-17T10:26:25.246 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2022-09-17T10:26:25.246 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon.b 2022-09-17T10:26:25.246 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2022-09-17T10:26:25.247 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-09-17T10:26:25.248 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-09-17T10:26:25.301 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID caff66e9-e5bf-4b11-8278-68b3c904b131... 2022-09-17T10:26:25.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-09-17T10:26:25.355 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-09-17T10:26:25.365 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-09-17T10:26:25.397 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2022-09-17T10:26:25.398 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2022-09-17T10:26:25.400 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-09-17T10:26:25.400 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2022-09-17T10:26:25.400 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.402 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2022-09-17T10:26:25.403 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.404 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2022-09-17T10:26:25.405 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.406 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2022-09-17T10:26:25.406 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2022-09-17T10:26:25.406 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.407 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2022-09-17T10:26:25.407 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2022-09-17T10:26:25.408 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.409 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2022-09-17T10:26:25.409 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2022-09-17T10:26:25.409 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.409 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2022-09-17T10:26:25.410 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2022-09-17T10:26:25.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.410 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2022-09-17T10:26:25.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.411 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2022-09-17T10:26:25.411 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2022-09-17T10:26:25.411 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2022-09-17T10:26:25.412 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2022-09-17T10:26:25.412 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2022-09-17T10:26:25.412 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2022-09-17T10:26:25.413 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2022-09-17T10:26:25.413 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-09-17T10:26:25.414 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2022-09-17T10:26:25.414 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2022-09-17T10:26:25.415 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.415 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-09-17T10:26:25.416 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.416 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2022-09-17T10:26:25.416 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.417 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2022-09-17T10:26:25.417 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.417 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2022-09-17T10:26:25.418 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2022-09-17T10:26:25.418 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2022-09-17T10:26:25.418 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,172.21.15.93,172.21.15.159" 2022-09-17T10:26:25.419 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on skipped message = False 2022-09-17T10:26:25.419 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = caff66e9-e5bf-4b11-8278-68b3c904b131 2022-09-17T10:26:25.420 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.420 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2022-09-17T10:26:25.421 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2022-09-17T10:26:25.421 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.421 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2022-09-17T10:26:25.422 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2022-09-17T10:26:25.422 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.423 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2022-09-17T10:26:25.423 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2022-09-17T10:26:25.423 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.424 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2022-09-17T10:26:25.424 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2022-09-17T10:26:25.424 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2022-09-17T10:26:25.424 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.425 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2022-09-17T10:26:25.425 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2022-09-17T10:26:25.425 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.426 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2022-09-17T10:26:25.426 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.426 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2022-09-17T10:26:25.427 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.427 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2022-09-17T10:26:25.427 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.427 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2022-09-17T10:26:25.428 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2022-09-17T10:26:25.428 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.428 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2022-09-17T10:26:25.428 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2022-09-17T10:26:25.429 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2022-09-17T10:26:25.429 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression mode = aggressive 2022-09-17T10:26:25.429 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2022-09-17T10:26:25.429 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 20 2022-09-17T10:26:25.429 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 20 2022-09-17T10:26:25.430 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2022-09-17T10:26:25.430 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2022-09-17T10:26:25.430 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2022-09-17T10:26:25.430 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2022-09-17T10:26:25.431 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2022-09-17T10:26:25.431 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2022-09-17T10:26:25.431 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2022-09-17T10:26:25.431 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2022-09-17T10:26:25.432 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2022-09-17T10:26:25.432 INFO:teuthology.orchestra.run.smithi062.stdout: osd shutdown pgref assert = True 2022-09-17T10:26:25.432 INFO:teuthology.orchestra.run.smithi062.stdout: osd_max_omap_entries_per_request = 10000 2022-09-17T10:26:25.432 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.432 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2022-09-17T10:26:25.433 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2022-09-17T10:26:25.433 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2022-09-17T10:26:25.433 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2022-09-17T10:26:25.434 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2022-09-17T10:26:25.434 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2022-09-17T10:26:25.434 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2022-09-17T10:26:25.434 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2022-09-17T10:26:25.435 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.435 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2022-09-17T10:26:25.435 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2022-09-17T10:26:25.435 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2022-09-17T10:26:25.436 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2022-09-17T10:26:25.436 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2022-09-17T10:26:25.436 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2022-09-17T10:26:25.436 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2022-09-17T10:26:25.436 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2022-09-17T10:26:25.437 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2022-09-17T10:26:25.437 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2022-09-17T10:26:25.437 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2022-09-17T10:26:25.437 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.438 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-09-17T10:26:25.438 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2022-09-17T10:26:25.438 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2022-09-17T10:26:25.438 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.439 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2022-09-17T10:26:25.439 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-09-17T10:26:25.440 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-09-17T10:26:25.441 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2022-09-17T10:26:25.441 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:26:25.442 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2022-09-17T10:26:25.442 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2022-09-17T10:26:25.442 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2022-09-17T10:26:25.443 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2022-09-17T10:26:25.443 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-09-17T10:26:25.444 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-09-17T10:26:25.444 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2022-09-17T10:26:25.445 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2022-09-17T10:26:25.445 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2022-09-17T10:26:25.446 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2022-09-17T10:26:25.446 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2022-09-17T10:26:25.447 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2022-09-17T10:26:25.447 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2022-09-17T10:26:25.447 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2022-09-17T10:26:25.448 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2022-09-17T10:26:25.448 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2022-09-17T10:26:25.449 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.g] 2022-09-17T10:26:25.449 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.j] 2022-09-17T10:26:25.449 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2022-09-17T10:26:25.450 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e] 2022-09-17T10:26:25.450 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.h] 2022-09-17T10:26:25.451 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.k] 2022-09-17T10:26:25.451 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2022-09-17T10:26:25.452 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f] 2022-09-17T10:26:25.452 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.i] 2022-09-17T10:26:25.452 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.l] 2022-09-17T10:26:25.453 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2022-09-17T10:26:25.453 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2022-09-17T10:26:25.454 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2022-09-17T10:26:25.455 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2022-09-17T10:26:25.455 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2022-09-17T10:26:25.455 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2022-09-17T10:26:25.456 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2022-09-17T10:26:25.456 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2022-09-17T10:26:25.456 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2022-09-17T10:26:25.457 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2022-09-17T10:26:25.457 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2022-09-17T10:26:25.457 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2022-09-17T10:26:25.458 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2022-09-17T10:26:25.458 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2022-09-17T10:26:25.463 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2022-09-17T10:26:25.463 INFO:teuthology.orchestra.run.smithi159.stdout: chdir = "" 2022-09-17T10:26:25.464 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-09-17T10:26:25.464 INFO:teuthology.orchestra.run.smithi159.stdout: auth supported = cephx 2022-09-17T10:26:25.465 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.465 INFO:teuthology.orchestra.run.smithi159.stdout: filestore xattr use omap = true 2022-09-17T10:26:25.465 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.466 INFO:teuthology.orchestra.run.smithi159.stdout: mon clock drift allowed = 1.000 2022-09-17T10:26:25.466 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.466 INFO:teuthology.orchestra.run.smithi159.stdout: osd crush chooseleaf type = 0 2022-09-17T10:26:25.466 INFO:teuthology.orchestra.run.smithi159.stdout: auth debug = true 2022-09-17T10:26:25.467 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.467 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on old message = true 2022-09-17T10:26:25.467 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on bug = true 2022-09-17T10:26:25.467 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.468 INFO:teuthology.orchestra.run.smithi159.stdout: mon max pg per osd = 10000 # >= luminous 2022-09-17T10:26:25.468 INFO:teuthology.orchestra.run.smithi159.stdout: mon pg warn max object skew = 0 2022-09-17T10:26:25.468 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.468 INFO:teuthology.orchestra.run.smithi159.stdout: # disable pg_autoscaler by default for new pools 2022-09-17T10:26:25.468 INFO:teuthology.orchestra.run.smithi159.stdout: osd_pool_default_pg_autoscale_mode = off 2022-09-17T10:26:25.469 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.469 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default size = 2 2022-09-17T10:26:25.469 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.469 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow primary affinity = true 2022-09-17T10:26:25.470 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow pg remap = true 2022-09-17T10:26:25.470 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on legacy crush tunables = false 2022-09-17T10:26:25.471 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on crush straw calc version zero = false 2022-09-17T10:26:25.471 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on no sortbitwise = false 2022-09-17T10:26:25.471 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on osd down out interval zero = false 2022-09-17T10:26:25.471 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on too few osds = false 2022-09-17T10:26:25.472 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-09-17T10:26:25.472 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_no_redundancy = false 2022-09-17T10:26:25.473 INFO:teuthology.orchestra.run.smithi159.stdout: mon_allow_pool_size_one = true 2022-09-17T10:26:25.473 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.473 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-09-17T10:26:25.474 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.475 INFO:teuthology.orchestra.run.smithi159.stdout: osd default data pool replay window = 5 2022-09-17T10:26:25.475 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.476 INFO:teuthology.orchestra.run.smithi159.stdout: mon allow pool delete = true 2022-09-17T10:26:25.476 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.477 INFO:teuthology.orchestra.run.smithi159.stdout: mon cluster log file level = debug 2022-09-17T10:26:25.477 INFO:teuthology.orchestra.run.smithi159.stdout: debug asserts on shutdown = true 2022-09-17T10:26:25.478 INFO:teuthology.orchestra.run.smithi159.stdout: mon health detail to clog = false 2022-09-17T10:26:25.478 INFO:teuthology.orchestra.run.smithi159.stdout: mon host = "172.21.15.62,172.21.15.93,172.21.15.159" 2022-09-17T10:26:25.478 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on skipped message = False 2022-09-17T10:26:25.479 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = caff66e9-e5bf-4b11-8278-68b3c904b131 2022-09-17T10:26:25.479 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.479 INFO:teuthology.orchestra.run.smithi159.stdout:[osd] 2022-09-17T10:26:25.480 INFO:teuthology.orchestra.run.smithi159.stdout: osd journal size = 100 2022-09-17T10:26:25.480 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.480 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub load threshold = 5.0 2022-09-17T10:26:25.481 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub max interval = 600 2022-09-17T10:26:25.481 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.482 INFO:teuthology.orchestra.run.smithi159.stdout: osd recover clone overlap = true 2022-09-17T10:26:25.482 INFO:teuthology.orchestra.run.smithi159.stdout: osd recovery max chunk = 1048576 2022-09-17T10:26:25.483 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.483 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug shutdown = true 2022-09-17T10:26:25.484 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug op order = true 2022-09-17T10:26:25.484 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug verify stray on activate = true 2022-09-17T10:26:25.485 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.485 INFO:teuthology.orchestra.run.smithi159.stdout: osd open classes on start = true 2022-09-17T10:26:25.485 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug pg log writeout = true 2022-09-17T10:26:25.486 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.487 INFO:teuthology.orchestra.run.smithi159.stdout: osd deep scrub update digest min age = 30 2022-09-17T10:26:25.487 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.487 INFO:teuthology.orchestra.run.smithi159.stdout: osd map max advance = 10 2022-09-17T10:26:25.488 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.488 INFO:teuthology.orchestra.run.smithi159.stdout: journal zero on create = true 2022-09-17T10:26:25.489 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.490 INFO:teuthology.orchestra.run.smithi159.stdout: filestore ondisk finisher threads = 3 2022-09-17T10:26:25.490 INFO:teuthology.orchestra.run.smithi159.stdout: filestore apply finisher threads = 3 2022-09-17T10:26:25.491 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.491 INFO:teuthology.orchestra.run.smithi159.stdout: bdev debug aio = true 2022-09-17T10:26:25.491 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug misdirected ops = true 2022-09-17T10:26:25.492 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore block size = 96636764160 2022-09-17T10:26:25.492 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore compression mode = aggressive 2022-09-17T10:26:25.493 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore fsck on mount = True 2022-09-17T10:26:25.493 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluefs = 20 2022-09-17T10:26:25.494 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluestore = 20 2022-09-17T10:26:25.494 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2022-09-17T10:26:25.495 INFO:teuthology.orchestra.run.smithi159.stdout: debug osd = 20 2022-09-17T10:26:25.495 INFO:teuthology.orchestra.run.smithi159.stdout: debug rocksdb = 10 2022-09-17T10:26:25.496 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd backfillfull_ratio = 0.85 2022-09-17T10:26:25.496 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd full ratio = 0.9 2022-09-17T10:26:25.496 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd nearfull ratio = 0.8 2022-09-17T10:26:25.496 INFO:teuthology.orchestra.run.smithi159.stdout: osd failsafe full ratio = 0.95 2022-09-17T10:26:25.497 INFO:teuthology.orchestra.run.smithi159.stdout: osd objectstore = bluestore 2022-09-17T10:26:25.497 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2022-09-17T10:26:25.497 INFO:teuthology.orchestra.run.smithi159.stdout: osd shutdown pgref assert = True 2022-09-17T10:26:25.497 INFO:teuthology.orchestra.run.smithi159.stdout: osd_max_omap_entries_per_request = 10000 2022-09-17T10:26:25.497 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.498 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr] 2022-09-17T10:26:25.498 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2022-09-17T10:26:25.498 INFO:teuthology.orchestra.run.smithi159.stdout: debug mgr = 20 2022-09-17T10:26:25.498 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2022-09-17T10:26:25.499 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2022-09-17T10:26:25.499 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2022-09-17T10:26:25.499 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2022-09-17T10:26:25.499 INFO:teuthology.orchestra.run.smithi159.stdout: mgr/telemetry/nag = false 2022-09-17T10:26:25.500 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.500 INFO:teuthology.orchestra.run.smithi159.stdout:[mon] 2022-09-17T10:26:25.500 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2022-09-17T10:26:25.500 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2022-09-17T10:26:25.500 INFO:teuthology.orchestra.run.smithi159.stdout: debug paxos = 20 2022-09-17T10:26:25.501 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2022-09-17T10:26:25.501 INFO:teuthology.orchestra.run.smithi159.stdout: mon data avail warn = 5 2022-09-17T10:26:25.501 INFO:teuthology.orchestra.run.smithi159.stdout: mon mgr mkfs grace = 240 2022-09-17T10:26:25.501 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2022-09-17T10:26:25.502 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd reporter subtree level = osd 2022-09-17T10:26:25.502 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd prime pg temp = true 2022-09-17T10:26:25.502 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2022-09-17T10:26:25.502 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.503 INFO:teuthology.orchestra.run.smithi159.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-09-17T10:26:25.503 INFO:teuthology.orchestra.run.smithi159.stdout: auth mon ticket ttl = 660 # 11m 2022-09-17T10:26:25.503 INFO:teuthology.orchestra.run.smithi159.stdout: auth service ticket ttl = 240 # 4m 2022-09-17T10:26:25.503 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.503 INFO:teuthology.orchestra.run.smithi159.stdout: # don't complain about insecure global_id in the test suite 2022-09-17T10:26:25.504 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-09-17T10:26:25.504 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-09-17T10:26:25.504 INFO:teuthology.orchestra.run.smithi159.stdout: mon op complaint time = 120 2022-09-17T10:26:25.504 INFO:teuthology.orchestra.run.smithi159.stdout: 2022-09-17T10:26:25.505 INFO:teuthology.orchestra.run.smithi159.stdout:[client] 2022-09-17T10:26:25.505 INFO:teuthology.orchestra.run.smithi159.stdout: rgw cache enabled = true 2022-09-17T10:26:25.505 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable ops log = true 2022-09-17T10:26:25.506 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable usage log = true 2022-09-17T10:26:25.506 INFO:teuthology.orchestra.run.smithi159.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-09-17T10:26:25.506 INFO:teuthology.orchestra.run.smithi159.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-09-17T10:26:25.506 INFO:teuthology.orchestra.run.smithi159.stdout: client mount timeout = 600 2022-09-17T10:26:25.507 INFO:teuthology.orchestra.run.smithi159.stdout: debug client = 20 2022-09-17T10:26:25.507 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2022-09-17T10:26:25.507 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2022-09-17T10:26:25.507 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2022-09-17T10:26:25.508 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.a] 2022-09-17T10:26:25.508 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.b] 2022-09-17T10:26:25.508 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.c] 2022-09-17T10:26:25.508 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2022-09-17T10:26:25.509 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2022-09-17T10:26:25.509 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.g] 2022-09-17T10:26:25.509 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.j] 2022-09-17T10:26:25.509 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2022-09-17T10:26:25.509 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.e] 2022-09-17T10:26:25.510 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.h] 2022-09-17T10:26:25.510 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.k] 2022-09-17T10:26:25.510 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2022-09-17T10:26:25.510 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.f] 2022-09-17T10:26:25.511 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.i] 2022-09-17T10:26:25.511 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.l] 2022-09-17T10:26:25.511 INFO:teuthology.orchestra.run.smithi159.stdout:[mds] 2022-09-17T10:26:25.511 INFO:teuthology.orchestra.run.smithi159.stdout: debug mds = 20 2022-09-17T10:26:25.511 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2022-09-17T10:26:25.512 INFO:teuthology.orchestra.run.smithi159.stdout: mds bal fragment size max = 10000 2022-09-17T10:26:25.512 INFO:teuthology.orchestra.run.smithi159.stdout: mds bal merge size = 5 2022-09-17T10:26:25.512 INFO:teuthology.orchestra.run.smithi159.stdout: mds bal split bits = 3 2022-09-17T10:26:25.512 INFO:teuthology.orchestra.run.smithi159.stdout: mds bal split size = 100 2022-09-17T10:26:25.513 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug frag = True 2022-09-17T10:26:25.513 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug scatterstat = True 2022-09-17T10:26:25.513 INFO:teuthology.orchestra.run.smithi159.stdout: mds op complaint time = 180 2022-09-17T10:26:25.513 INFO:teuthology.orchestra.run.smithi159.stdout: mds verify scatter = True 2022-09-17T10:26:25.513 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2022-09-17T10:26:25.514 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2022-09-17T10:26:25.514 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2022-09-17T10:26:25.514 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2022-09-17T10:26:25.515 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2022-09-17T10:26:25.515 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-09-17T10:26:25.515 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2022-09-17T10:26:25.515 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.515 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2022-09-17T10:26:25.516 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.516 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2022-09-17T10:26:25.516 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.516 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2022-09-17T10:26:25.517 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2022-09-17T10:26:25.517 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.517 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2022-09-17T10:26:25.517 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2022-09-17T10:26:25.517 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.518 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2022-09-17T10:26:25.518 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2022-09-17T10:26:25.518 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.518 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2022-09-17T10:26:25.519 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2022-09-17T10:26:25.519 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.519 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2022-09-17T10:26:25.519 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.520 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2022-09-17T10:26:25.520 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2022-09-17T10:26:25.520 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2022-09-17T10:26:25.520 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2022-09-17T10:26:25.521 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2022-09-17T10:26:25.521 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2022-09-17T10:26:25.521 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2022-09-17T10:26:25.521 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-09-17T10:26:25.522 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2022-09-17T10:26:25.522 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2022-09-17T10:26:25.522 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.522 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-09-17T10:26:25.522 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.523 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2022-09-17T10:26:25.523 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.523 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2022-09-17T10:26:25.523 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.524 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2022-09-17T10:26:25.524 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2022-09-17T10:26:25.524 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2022-09-17T10:26:25.524 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.62,172.21.15.93,172.21.15.159" 2022-09-17T10:26:25.525 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on skipped message = False 2022-09-17T10:26:25.525 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = caff66e9-e5bf-4b11-8278-68b3c904b131 2022-09-17T10:26:25.525 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.525 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2022-09-17T10:26:25.525 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2022-09-17T10:26:25.526 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.526 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2022-09-17T10:26:25.526 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2022-09-17T10:26:25.526 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.527 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2022-09-17T10:26:25.527 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2022-09-17T10:26:25.527 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.527 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2022-09-17T10:26:25.527 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2022-09-17T10:26:25.528 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2022-09-17T10:26:25.528 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.528 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2022-09-17T10:26:25.528 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2022-09-17T10:26:25.529 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.529 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2022-09-17T10:26:25.529 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.529 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2022-09-17T10:26:25.530 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.530 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2022-09-17T10:26:25.530 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.530 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2022-09-17T10:26:25.530 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2022-09-17T10:26:25.531 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.531 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2022-09-17T10:26:25.531 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2022-09-17T10:26:25.531 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2022-09-17T10:26:25.532 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore compression mode = aggressive 2022-09-17T10:26:25.532 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2022-09-17T10:26:25.532 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 20 2022-09-17T10:26:25.532 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 20 2022-09-17T10:26:25.532 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2022-09-17T10:26:25.533 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2022-09-17T10:26:25.533 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 10 2022-09-17T10:26:25.533 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2022-09-17T10:26:25.533 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2022-09-17T10:26:25.534 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2022-09-17T10:26:25.534 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2022-09-17T10:26:25.534 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2022-09-17T10:26:25.534 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2022-09-17T10:26:25.534 INFO:teuthology.orchestra.run.smithi093.stdout: osd shutdown pgref assert = True 2022-09-17T10:26:25.535 INFO:teuthology.orchestra.run.smithi093.stdout: osd_max_omap_entries_per_request = 10000 2022-09-17T10:26:25.535 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.535 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2022-09-17T10:26:25.535 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2022-09-17T10:26:25.536 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2022-09-17T10:26:25.536 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2022-09-17T10:26:25.536 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2022-09-17T10:26:25.536 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2022-09-17T10:26:25.536 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2022-09-17T10:26:25.537 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2022-09-17T10:26:25.537 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.538 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2022-09-17T10:26:25.538 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2022-09-17T10:26:25.539 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2022-09-17T10:26:25.539 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2022-09-17T10:26:25.539 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2022-09-17T10:26:25.540 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2022-09-17T10:26:25.540 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2022-09-17T10:26:25.541 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2022-09-17T10:26:25.541 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2022-09-17T10:26:25.542 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2022-09-17T10:26:25.542 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2022-09-17T10:26:25.543 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.543 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-09-17T10:26:25.544 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2022-09-17T10:26:25.544 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2022-09-17T10:26:25.545 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.545 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2022-09-17T10:26:25.545 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-09-17T10:26:25.546 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-09-17T10:26:25.546 INFO:teuthology.orchestra.run.smithi093.stdout: mon op complaint time = 120 2022-09-17T10:26:25.547 INFO:teuthology.orchestra.run.smithi093.stdout: 2022-09-17T10:26:25.547 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2022-09-17T10:26:25.548 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2022-09-17T10:26:25.548 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2022-09-17T10:26:25.549 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2022-09-17T10:26:25.549 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-09-17T10:26:25.550 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-09-17T10:26:25.550 INFO:teuthology.orchestra.run.smithi093.stdout: client mount timeout = 600 2022-09-17T10:26:25.551 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2022-09-17T10:26:25.551 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2022-09-17T10:26:25.552 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2022-09-17T10:26:25.552 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2022-09-17T10:26:25.552 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2022-09-17T10:26:25.553 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2022-09-17T10:26:25.553 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2022-09-17T10:26:25.554 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2022-09-17T10:26:25.554 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2022-09-17T10:26:25.555 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.g] 2022-09-17T10:26:25.555 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.j] 2022-09-17T10:26:25.556 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2022-09-17T10:26:25.556 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.e] 2022-09-17T10:26:25.557 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.h] 2022-09-17T10:26:25.557 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.k] 2022-09-17T10:26:25.558 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2022-09-17T10:26:25.558 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.f] 2022-09-17T10:26:25.558 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.i] 2022-09-17T10:26:25.559 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.l] 2022-09-17T10:26:25.559 INFO:teuthology.orchestra.run.smithi093.stdout:[mds] 2022-09-17T10:26:25.560 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds = 20 2022-09-17T10:26:25.560 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2022-09-17T10:26:25.561 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal fragment size max = 10000 2022-09-17T10:26:25.561 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal merge size = 5 2022-09-17T10:26:25.562 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal split bits = 3 2022-09-17T10:26:25.562 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal split size = 100 2022-09-17T10:26:25.563 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug frag = True 2022-09-17T10:26:25.563 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug scatterstat = True 2022-09-17T10:26:25.563 INFO:teuthology.orchestra.run.smithi093.stdout: mds op complaint time = 180 2022-09-17T10:26:25.564 INFO:teuthology.orchestra.run.smithi093.stdout: mds verify scatter = True 2022-09-17T10:26:25.564 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2022-09-17T10:26:25.565 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2022-09-17T10:26:25.565 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2022-09-17T10:26:25.566 INFO:tasks.ceph:Creating admin key on mon.a... 2022-09-17T10:26:25.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-09-17T10:26:25.628 INFO:tasks.ceph:Copying monmap to all nodes... 2022-09-17T10:26:25.629 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:25.629 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-09-17T10:26:25.646 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:25.647 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-09-17T10:26:25.702 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2022-09-17T10:26:25.702 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:25.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2022-09-17T10:26:25.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-17T10:26:25.777 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:26:25.778 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:25.835 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi093.front.sepia.ceph.com 2022-09-17T10:26:25.835 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:26:25.836 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.keyring 2022-09-17T10:26:25.836 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-17T10:26:25.880 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:26:25.881 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:25.939 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi159.front.sepia.ceph.com 2022-09-17T10:26:25.940 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:26:25.941 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.keyring 2022-09-17T10:26:25.941 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-17T10:26:25.985 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:26:25.986 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:26.042 INFO:tasks.ceph:Setting up mon nodes... 2022-09-17T10:26:26.043 INFO:tasks.ceph:Setting up mgr nodes... 2022-09-17T10:26:26.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-09-17T10:26:26.095 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-09-17T10:26:26.101 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-09-17T10:26:26.169 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-09-17T10:26:26.173 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2022-09-17T10:26:26.247 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2022-09-17T10:26:26.249 INFO:tasks.ceph:Setting up mds nodes... 2022-09-17T10:26:26.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-09-17T10:26:26.300 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-09-17T10:26:26.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-09-17T10:26:26.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-09-17T10:26:26.417 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-09-17T10:26:26.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-09-17T10:26:26.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-g && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.g /var/lib/ceph/mds/ceph-g/keyring 2022-09-17T10:26:26.534 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-g/keyring 2022-09-17T10:26:26.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-g 2022-09-17T10:26:26.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-j && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.j /var/lib/ceph/mds/ceph-j/keyring 2022-09-17T10:26:26.651 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-j/keyring 2022-09-17T10:26:26.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-j 2022-09-17T10:26:26.679 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-09-17T10:26:26.734 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-09-17T10:26:26.737 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-09-17T10:26:26.766 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2022-09-17T10:26:26.860 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2022-09-17T10:26:26.861 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2022-09-17T10:26:26.886 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-h && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.h /var/lib/ceph/mds/ceph-h/keyring 2022-09-17T10:26:26.975 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-h/keyring 2022-09-17T10:26:26.976 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-h 2022-09-17T10:26:27.001 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-k && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.k /var/lib/ceph/mds/ceph-k/keyring 2022-09-17T10:26:27.086 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-k/keyring 2022-09-17T10:26:27.088 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-k 2022-09-17T10:26:27.113 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-09-17T10:26:27.168 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-09-17T10:26:27.171 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-09-17T10:26:27.200 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2022-09-17T10:26:27.289 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2022-09-17T10:26:27.292 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2022-09-17T10:26:27.319 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-i && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.i /var/lib/ceph/mds/ceph-i/keyring 2022-09-17T10:26:27.406 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-i/keyring 2022-09-17T10:26:27.409 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-i 2022-09-17T10:26:27.435 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-l && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.l /var/lib/ceph/mds/ceph-l/keyring 2022-09-17T10:26:27.522 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-l/keyring 2022-09-17T10:26:27.524 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-l 2022-09-17T10:26:27.556 INFO:tasks.ceph_client:Setting up client nodes... 2022-09-17T10:26:27.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-09-17T10:26:27.603 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-09-17T10:26:27.618 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-09-17T10:26:27.619 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2022-09-17T10:26:27.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-09-17T10:26:27.688 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:27.689 INFO:tasks.ceph:role: osd.0 2022-09-17T10:26:27.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2022-09-17T10:26:27.690 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-09-17T10:26:27.763 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:27.764 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:27.764 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:27.764 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2022-09-17T10:26:27.765 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:27.765 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:27.765 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:27.765 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:27.766 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:27.766 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:28.191 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2022-09-17T10:26:28.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2022-09-17T10:26:28.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-09-17T10:26:28.372 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-09-17T10:26:28.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-09-17T10:26:28.477 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:28.480 INFO:tasks.ceph:role: osd.3 2022-09-17T10:26:28.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2022-09-17T10:26:28.481 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-09-17T10:26:28.557 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:28.557 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:28.558 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:28.558 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2022-09-17T10:26:28.558 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:28.558 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:28.558 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:28.559 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:28.559 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:28.559 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:28.982 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2022-09-17T10:26:28.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2022-09-17T10:26:28.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2022-09-17T10:26:29.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-09-17T10:26:29.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-09-17T10:26:29.189 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:29.190 INFO:tasks.ceph:role: osd.6 2022-09-17T10:26:29.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2022-09-17T10:26:29.191 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-09-17T10:26:29.270 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:29.271 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:29.272 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:29.272 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2022-09-17T10:26:29.273 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:29.273 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:29.274 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:29.274 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:29.275 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:29.275 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:29.721 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2022-09-17T10:26:29.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2022-09-17T10:26:29.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-09-17T10:26:29.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-09-17T10:26:29.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2022-09-17T10:26:29.993 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:29.993 INFO:tasks.ceph:role: osd.9 2022-09-17T10:26:29.994 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2022-09-17T10:26:29.994 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-09-17T10:26:30.069 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:30.071 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:30.071 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:30.071 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2022-09-17T10:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:30.072 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:30.073 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:30.073 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:30.508 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2022-09-17T10:26:30.509 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2022-09-17T10:26:30.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2022-09-17T10:26:30.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2022-09-17T10:26:30.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:30.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:30.809+0000 7fee26fb9200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-09-17T10:26:30.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:30.809+0000 7fee26fb9200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-09-17T10:26:30.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:30.809+0000 7fee26fb9200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-17T10:26:30.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:30.809+0000 7fee26fb9200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-17T10:26:30.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:30.809+0000 7fee26fb9200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-17T10:26:30.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:30.810+0000 7fee26fb9200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-09-17T10:26:33.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-09-17T10:26:33.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:33.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:33.806+0000 7f3f619d3200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-09-17T10:26:33.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:33.806+0000 7f3f619d3200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-09-17T10:26:33.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:33.806+0000 7f3f619d3200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-17T10:26:33.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:33.806+0000 7f3f619d3200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-17T10:26:33.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:33.806+0000 7f3f619d3200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-17T10:26:33.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:33.807+0000 7f3f619d3200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-09-17T10:26:36.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-09-17T10:26:36.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:36.784+0000 7f00336dd200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-09-17T10:26:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:36.785+0000 7f00336dd200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-09-17T10:26:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:36.785+0000 7f00336dd200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-17T10:26:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:36.785+0000 7f00336dd200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-17T10:26:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:36.785+0000 7f00336dd200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-17T10:26:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:36.785+0000 7f00336dd200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-09-17T10:26:39.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-09-17T10:26:39.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:39.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:39.782+0000 7f4831d4f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2022-09-17T10:26:39.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:39.783+0000 7f4831d4f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2022-09-17T10:26:39.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:39.783+0000 7f4831d4f200 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2022-09-17T10:26:39.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:39.783+0000 7f4831d4f200 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2022-09-17T10:26:39.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:39.783+0000 7f4831d4f200 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2022-09-17T10:26:39.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:26:39.783+0000 7f4831d4f200 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2022-09-17T10:26:42.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2022-09-17T10:26:42.674 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-09-17T10:26:42.705 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:42.706 INFO:tasks.ceph:role: osd.1 2022-09-17T10:26:42.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com 2022-09-17T10:26:42.707 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-09-17T10:26:42.780 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:42.781 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:42.781 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:42.782 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2022-09-17T10:26:42.782 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:42.782 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:42.782 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:42.783 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:42.783 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:42.783 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:43.206 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2022-09-17T10:26:43.208 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2022-09-17T10:26:43.209 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2022-09-17T10:26:43.381 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-09-17T10:26:43.422 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-09-17T10:26:43.491 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:43.491 INFO:tasks.ceph:role: osd.4 2022-09-17T10:26:43.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com 2022-09-17T10:26:43.492 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-09-17T10:26:43.566 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:43.567 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:43.567 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:43.567 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2022-09-17T10:26:43.567 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:43.568 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:43.568 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:43.568 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:43.568 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:43.569 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:43.994 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2022-09-17T10:26:43.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2022-09-17T10:26:43.997 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2022-09-17T10:26:44.109 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-09-17T10:26:44.147 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-09-17T10:26:44.218 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:44.219 INFO:tasks.ceph:role: osd.7 2022-09-17T10:26:44.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com 2022-09-17T10:26:44.220 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-09-17T10:26:44.295 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:44.296 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:44.296 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:44.296 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2022-09-17T10:26:44.297 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:44.297 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:44.297 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:44.297 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:44.298 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:44.298 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:44.749 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2022-09-17T10:26:44.750 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2022-09-17T10:26:44.751 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2022-09-17T10:26:44.870 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-09-17T10:26:44.903 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2022-09-17T10:26:44.970 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:44.971 INFO:tasks.ceph:role: osd.10 2022-09-17T10:26:44.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com 2022-09-17T10:26:44.972 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-09-17T10:26:45.045 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:45.045 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:45.045 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:45.046 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2022-09-17T10:26:45.046 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:45.046 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:45.046 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:45.047 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:45.047 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:45.047 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:45.491 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2022-09-17T10:26:45.493 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2022-09-17T10:26:45.494 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2022-09-17T10:26:45.643 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2022-09-17T10:26:45.678 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:45.767 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:45.764+0000 7fcd81b4f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-09-17T10:26:45.767 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:45.764+0000 7fcd81b4f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-09-17T10:26:45.767 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:45.764+0000 7fcd81b4f200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-17T10:26:45.768 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:45.764+0000 7fcd81b4f200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-17T10:26:45.768 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:45.764+0000 7fcd81b4f200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-17T10:26:45.768 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:45.765+0000 7fcd81b4f200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-09-17T10:26:48.614 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-09-17T10:26:48.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:48.726 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:48.723+0000 7f400e298200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-09-17T10:26:48.726 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:48.724+0000 7f400e298200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-09-17T10:26:48.726 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:48.724+0000 7f400e298200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-17T10:26:48.727 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:48.724+0000 7f400e298200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-17T10:26:48.727 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:48.724+0000 7f400e298200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-17T10:26:48.727 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:48.724+0000 7f400e298200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-09-17T10:26:51.583 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-09-17T10:26:51.655 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:51.740+0000 7fd8a740e200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-09-17T10:26:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:51.741+0000 7fd8a740e200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-09-17T10:26:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:51.741+0000 7fd8a740e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-17T10:26:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:51.741+0000 7fd8a740e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-17T10:26:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:51.741+0000 7fd8a740e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-17T10:26:51.747 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:51.741+0000 7fd8a740e200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-09-17T10:26:53.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:53.795 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:53.798 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:26:54.599 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-09-17T10:26:54.629 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:26:54.721 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:54.711+0000 7f23c0f81200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2022-09-17T10:26:54.721 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:54.711+0000 7f23c0f81200 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2022-09-17T10:26:54.722 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:54.711+0000 7f23c0f81200 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2022-09-17T10:26:54.722 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:54.711+0000 7f23c0f81200 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2022-09-17T10:26:54.723 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:54.711+0000 7f23c0f81200 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2022-09-17T10:26:54.723 INFO:teuthology.orchestra.run.smithi093.stderr:2022-09-17T10:26:54.712+0000 7f23c0f81200 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2022-09-17T10:26:57.567 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2022-09-17T10:26:57.641 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-09-17T10:26:57.671 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:57.672 INFO:tasks.ceph:role: osd.2 2022-09-17T10:26:57.673 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com 2022-09-17T10:26:57.673 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-09-17T10:26:57.748 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:57.748 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:57.749 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:57.749 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 2022-09-17T10:26:57.750 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:57.750 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:57.751 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:57.751 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:57.752 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:57.752 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:58.179 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2022-09-17T10:26:58.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2022-09-17T10:26:58.183 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2022-09-17T10:26:58.357 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-09-17T10:26:58.392 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-09-17T10:26:58.463 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:58.464 INFO:tasks.ceph:role: osd.5 2022-09-17T10:26:58.465 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com 2022-09-17T10:26:58.465 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-09-17T10:26:58.536 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:58.537 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:58.537 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:58.538 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 2022-09-17T10:26:58.538 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:58.539 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:58.539 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:58.540 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:58.540 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:58.541 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:58.961 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2022-09-17T10:26:58.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2022-09-17T10:26:58.963 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-09-17T10:26:59.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-09-17T10:26:59.118 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2022-09-17T10:26:59.184 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:59.184 INFO:tasks.ceph:role: osd.8 2022-09-17T10:26:59.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com 2022-09-17T10:26:59.185 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-09-17T10:26:59.262 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:26:59.263 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:26:59.263 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:26:59.263 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 2022-09-17T10:26:59.264 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:26:59.264 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:26:59.264 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:26:59.264 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:26:59.265 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:26:59.265 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:26:59.706 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2022-09-17T10:26:59.708 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2022-09-17T10:26:59.708 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2022-09-17T10:26:59.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2022-09-17T10:26:59.894 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2022-09-17T10:26:59.961 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2022-09-17T10:26:59.962 INFO:tasks.ceph:role: osd.11 2022-09-17T10:26:59.963 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com 2022-09-17T10:26:59.964 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-09-17T10:27:00.034 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-09-17T10:27:00.035 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-17T10:27:00.035 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-17T10:27:00.035 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 2022-09-17T10:27:00.036 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-17T10:27:00.036 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2022-09-17T10:27:00.036 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-17T10:27:00.037 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-17T10:27:00.037 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-17T10:27:00.037 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-17T10:27:00.484 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2022-09-17T10:27:00.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2022-09-17T10:27:00.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2022-09-17T10:27:00.666 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2022-09-17T10:27:00.702 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:27:00.786 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:00.780+0000 7f704d307200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-09-17T10:27:00.787 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:00.781+0000 7f704d307200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-09-17T10:27:00.787 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:00.781+0000 7f704d307200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-17T10:27:00.788 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:00.781+0000 7f704d307200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-17T10:27:00.788 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:00.781+0000 7f704d307200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-17T10:27:00.788 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:00.781+0000 7f704d307200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-09-17T10:27:03.640 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-09-17T10:27:03.715 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:27:03.801 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:03.796+0000 7f00537d0200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-09-17T10:27:03.802 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:03.797+0000 7f00537d0200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-09-17T10:27:03.802 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:03.797+0000 7f00537d0200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-17T10:27:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:03.797+0000 7f00537d0200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-17T10:27:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:03.797+0000 7f00537d0200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-17T10:27:03.804 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:03.797+0000 7f00537d0200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-09-17T10:27:06.650 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-09-17T10:27:06.678 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:27:06.763 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:06.759+0000 7efc900f3200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2022-09-17T10:27:06.763 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:06.760+0000 7efc900f3200 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2022-09-17T10:27:06.763 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:06.760+0000 7efc900f3200 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2022-09-17T10:27:06.764 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:06.760+0000 7efc900f3200 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2022-09-17T10:27:06.764 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:06.760+0000 7efc900f3200 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2022-09-17T10:27:06.765 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:06.760+0000 7efc900f3200 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2022-09-17T10:27:09.622 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2022-09-17T10:27:09.693 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:27:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:09.776+0000 7f3354ae5200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2022-09-17T10:27:09.780 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:09.776+0000 7f3354ae5200 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2022-09-17T10:27:09.780 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:09.776+0000 7f3354ae5200 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2022-09-17T10:27:09.780 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:09.776+0000 7f3354ae5200 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2022-09-17T10:27:09.780 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:09.776+0000 7f3354ae5200 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2022-09-17T10:27:09.781 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:09.777+0000 7f3354ae5200 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2022-09-17T10:27:12.627 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2022-09-17T10:27:12.657 INFO:tasks.ceph:Reading keys from all nodes... 2022-09-17T10:27:12.659 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:12.659 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-09-17T10:27:12.692 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:12.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-09-17T10:27:12.763 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:12.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-09-17T10:27:12.834 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:12.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-g/keyring of=/dev/stdout 2022-09-17T10:27:12.904 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:12.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-j/keyring of=/dev/stdout 2022-09-17T10:27:12.973 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:12.973 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-09-17T10:27:13.041 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:13.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-09-17T10:27:13.108 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:13.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-09-17T10:27:13.176 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:13.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2022-09-17T10:27:13.246 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.247 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-09-17T10:27:13.277 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.277 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-09-17T10:27:13.347 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2022-09-17T10:27:13.413 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.413 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-h/keyring of=/dev/stdout 2022-09-17T10:27:13.478 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.478 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-k/keyring of=/dev/stdout 2022-09-17T10:27:13.544 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.545 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-09-17T10:27:13.611 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.611 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-09-17T10:27:13.677 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.678 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-09-17T10:27:13.741 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:13.742 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2022-09-17T10:27:13.806 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:13.807 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2022-09-17T10:27:13.837 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:13.838 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-09-17T10:27:13.907 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:13.908 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2022-09-17T10:27:13.975 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:13.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-i/keyring of=/dev/stdout 2022-09-17T10:27:14.045 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:14.047 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-l/keyring of=/dev/stdout 2022-09-17T10:27:14.112 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:14.113 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-09-17T10:27:14.184 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:14.184 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-09-17T10:27:14.249 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:14.250 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2022-09-17T10:27:14.315 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:14.316 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2022-09-17T10:27:14.381 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:14.383 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-09-17T10:27:14.405 INFO:tasks.ceph:Adding keys to all mons... 2022-09-17T10:27:14.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2022-09-17T10:27:14.449 DEBUG:teuthology.orchestra.run.smithi093:> sudo tee -a /etc/ceph/ceph.keyring 2022-09-17T10:27:14.453 DEBUG:teuthology.orchestra.run.smithi159:> sudo tee -a /etc/ceph/ceph.keyring 2022-09-17T10:27:14.481 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.x] 2022-09-17T10:27:14.482 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVjy9+XBRAAMYhsMQdiDf12xALFne304Q== 2022-09-17T10:27:14.483 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2022-09-17T10:27:14.483 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVjQHrQERAApZOAKTkpko4xvPwbiCfTkQ== 2022-09-17T10:27:14.484 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2022-09-17T10:27:14.484 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVjE3rNGBAA+1XqVrAb3xpr4LIO9Yku6Q== 2022-09-17T10:27:14.484 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.g] 2022-09-17T10:27:14.485 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVj0jrGHxAAusmPY3sxOdcLOuFJbmBq5A== 2022-09-17T10:27:14.485 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.j] 2022-09-17T10:27:14.486 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVj5WS5JhAAAYMf9OXYSILLWswvSE9LYw== 2022-09-17T10:27:14.486 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.0] 2022-09-17T10:27:14.487 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDWoCVjeGlMMBAAUjTctKHkWwQDyJsm5Ak2sg== 2022-09-17T10:27:14.487 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.3] 2022-09-17T10:27:14.487 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDZoCVj4DsgMBAAN4LanXkwy4eEcPyI5deMJA== 2022-09-17T10:27:14.488 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.6] 2022-09-17T10:27:14.488 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDcoCVjDinVLhAAmMnZVgKyT+kg8AB3lP2BDw== 2022-09-17T10:27:14.489 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.9] 2022-09-17T10:27:14.489 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDfoCVjih21LhAAspml0i23NlcEpG2njVuUEQ== 2022-09-17T10:27:14.490 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.y] 2022-09-17T10:27:14.490 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVj7f4DChAAbu5hZapqANq0Ssm1yusFJA== 2022-09-17T10:27:14.490 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2022-09-17T10:27:14.491 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVj/Qi+KxAAJf4IuMHO8yKZxe0CWBGHSw== 2022-09-17T10:27:14.491 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.e] 2022-09-17T10:27:14.491 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVji4wJMxAAS/uMvalG3IYlwpb6FYMPdA== 2022-09-17T10:27:14.491 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.h] 2022-09-17T10:27:14.492 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVjAhH3ORAAUpw2opYpfFrU4hz1BvUuTQ== 2022-09-17T10:27:14.492 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.k] 2022-09-17T10:27:14.492 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDToCVjQjscBRAAzyJQm3+Ap0aleZJrO/VuQA== 2022-09-17T10:27:14.492 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.1] 2022-09-17T10:27:14.493 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDloCVjCAiYLRAAjjZsAQg0lgg5ROycZp85sg== 2022-09-17T10:27:14.493 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.4] 2022-09-17T10:27:14.493 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDooCVj1xMvKxAAzTuJi5ruqLS3UKBbImua1A== 2022-09-17T10:27:14.493 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.7] 2022-09-17T10:27:14.494 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDroCVj4NEzLBAAWpNoNGTeAJxhaFAj6MNtwQ== 2022-09-17T10:27:14.494 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.10] 2022-09-17T10:27:14.494 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDuoCVjNHxzKhAAeL9QXIZpu7+Y+qs7tSNqJw== 2022-09-17T10:27:14.495 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.z] 2022-09-17T10:27:14.495 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDSoCVjgqasDhAALErVDBITnAgIJl0axzokVw== 2022-09-17T10:27:14.496 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2022-09-17T10:27:14.496 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDToCVji1D5CRAAvBA4fE9+ruzBkSsA3AYMyQ== 2022-09-17T10:27:14.496 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.f] 2022-09-17T10:27:14.496 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDToCVj7yoxERAA56sDfjQRbj0j4zsC/3Bt7A== 2022-09-17T10:27:14.497 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.i] 2022-09-17T10:27:14.497 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDToCVjuuwqGBAAVHOCl0ZO4HClt2GRdFcmiA== 2022-09-17T10:27:14.497 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.l] 2022-09-17T10:27:14.497 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDToCVjCWkRHxAAYwUguP9sgKibmyxawJfHvg== 2022-09-17T10:27:14.498 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.2] 2022-09-17T10:27:14.498 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQD0oCVjJEakLhAAZlqHtA5gAWi0UbVEfh98Dw== 2022-09-17T10:27:14.498 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.5] 2022-09-17T10:27:14.498 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQD3oCVjDIWYLxAAUuKrLtHs5PUYXdQY2niSIw== 2022-09-17T10:27:14.499 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.8] 2022-09-17T10:27:14.499 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQD6oCVjRYVlLRAAmelzxqUgr6Hf8XfvtmKR6g== 2022-09-17T10:27:14.499 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.11] 2022-09-17T10:27:14.499 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQD9oCVjYUxfLhAAckxtup17xphTVzny2LZFjA== 2022-09-17T10:27:14.500 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2022-09-17T10:27:14.500 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDToCVjz3LnIxAA0j8pucppSDEvZJO1salT0Q== 2022-09-17T10:27:14.500 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2022-09-17T10:27:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVjy9+XBRAAMYhsMQdiDf12xALFne304Q== 2022-09-17T10:27:14.501 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2022-09-17T10:27:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVjQHrQERAApZOAKTkpko4xvPwbiCfTkQ== 2022-09-17T10:27:14.501 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2022-09-17T10:27:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVjE3rNGBAA+1XqVrAb3xpr4LIO9Yku6Q== 2022-09-17T10:27:14.502 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.g] 2022-09-17T10:27:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVj0jrGHxAAusmPY3sxOdcLOuFJbmBq5A== 2022-09-17T10:27:14.502 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.j] 2022-09-17T10:27:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVj5WS5JhAAAYMf9OXYSILLWswvSE9LYw== 2022-09-17T10:27:14.503 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2022-09-17T10:27:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDWoCVjeGlMMBAAUjTctKHkWwQDyJsm5Ak2sg== 2022-09-17T10:27:14.504 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2022-09-17T10:27:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDZoCVj4DsgMBAAN4LanXkwy4eEcPyI5deMJA== 2022-09-17T10:27:14.504 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2022-09-17T10:27:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDcoCVjDinVLhAAmMnZVgKyT+kg8AB3lP2BDw== 2022-09-17T10:27:14.505 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.9] 2022-09-17T10:27:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDfoCVjih21LhAAspml0i23NlcEpG2njVuUEQ== 2022-09-17T10:27:14.505 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2022-09-17T10:27:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVj7f4DChAAbu5hZapqANq0Ssm1yusFJA== 2022-09-17T10:27:14.506 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2022-09-17T10:27:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVj/Qi+KxAAJf4IuMHO8yKZxe0CWBGHSw== 2022-09-17T10:27:14.506 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e] 2022-09-17T10:27:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVji4wJMxAAS/uMvalG3IYlwpb6FYMPdA== 2022-09-17T10:27:14.507 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.h] 2022-09-17T10:27:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVjAhH3ORAAUpw2opYpfFrU4hz1BvUuTQ== 2022-09-17T10:27:14.507 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.k] 2022-09-17T10:27:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDToCVjQjscBRAAzyJQm3+Ap0aleZJrO/VuQA== 2022-09-17T10:27:14.508 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2022-09-17T10:27:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDloCVjCAiYLRAAjjZsAQg0lgg5ROycZp85sg== 2022-09-17T10:27:14.508 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2022-09-17T10:27:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDooCVj1xMvKxAAzTuJi5ruqLS3UKBbImua1A== 2022-09-17T10:27:14.509 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2022-09-17T10:27:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDroCVj4NEzLBAAWpNoNGTeAJxhaFAj6MNtwQ== 2022-09-17T10:27:14.509 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.10] 2022-09-17T10:27:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDuoCVjNHxzKhAAeL9QXIZpu7+Y+qs7tSNqJw== 2022-09-17T10:27:14.510 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.z] 2022-09-17T10:27:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDSoCVjgqasDhAALErVDBITnAgIJl0axzokVw== 2022-09-17T10:27:14.510 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2022-09-17T10:27:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDToCVji1D5CRAAvBA4fE9+ruzBkSsA3AYMyQ== 2022-09-17T10:27:14.511 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f] 2022-09-17T10:27:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDToCVj7yoxERAA56sDfjQRbj0j4zsC/3Bt7A== 2022-09-17T10:27:14.511 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.i] 2022-09-17T10:27:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDToCVjuuwqGBAAVHOCl0ZO4HClt2GRdFcmiA== 2022-09-17T10:27:14.512 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.l] 2022-09-17T10:27:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDToCVjCWkRHxAAYwUguP9sgKibmyxawJfHvg== 2022-09-17T10:27:14.512 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2022-09-17T10:27:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD0oCVjJEakLhAAZlqHtA5gAWi0UbVEfh98Dw== 2022-09-17T10:27:14.513 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2022-09-17T10:27:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD3oCVjDIWYLxAAUuKrLtHs5PUYXdQY2niSIw== 2022-09-17T10:27:14.513 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.8] 2022-09-17T10:27:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD6oCVjRYVlLRAAmelzxqUgr6Hf8XfvtmKR6g== 2022-09-17T10:27:14.514 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.11] 2022-09-17T10:27:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQD9oCVjYUxfLhAAckxtup17xphTVzny2LZFjA== 2022-09-17T10:27:14.514 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2022-09-17T10:27:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDToCVjz3LnIxAA0j8pucppSDEvZJO1salT0Q== 2022-09-17T10:27:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.x] 2022-09-17T10:27:14.515 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVjy9+XBRAAMYhsMQdiDf12xALFne304Q== 2022-09-17T10:27:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2022-09-17T10:27:14.515 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVjQHrQERAApZOAKTkpko4xvPwbiCfTkQ== 2022-09-17T10:27:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2022-09-17T10:27:14.516 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVjE3rNGBAA+1XqVrAb3xpr4LIO9Yku6Q== 2022-09-17T10:27:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.g] 2022-09-17T10:27:14.516 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVj0jrGHxAAusmPY3sxOdcLOuFJbmBq5A== 2022-09-17T10:27:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.j] 2022-09-17T10:27:14.517 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVj5WS5JhAAAYMf9OXYSILLWswvSE9LYw== 2022-09-17T10:27:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2022-09-17T10:27:14.517 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDWoCVjeGlMMBAAUjTctKHkWwQDyJsm5Ak2sg== 2022-09-17T10:27:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.3] 2022-09-17T10:27:14.518 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDZoCVj4DsgMBAAN4LanXkwy4eEcPyI5deMJA== 2022-09-17T10:27:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.6] 2022-09-17T10:27:14.518 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDcoCVjDinVLhAAmMnZVgKyT+kg8AB3lP2BDw== 2022-09-17T10:27:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.9] 2022-09-17T10:27:14.519 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDfoCVjih21LhAAspml0i23NlcEpG2njVuUEQ== 2022-09-17T10:27:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.y] 2022-09-17T10:27:14.519 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVj7f4DChAAbu5hZapqANq0Ssm1yusFJA== 2022-09-17T10:27:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2022-09-17T10:27:14.520 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVj/Qi+KxAAJf4IuMHO8yKZxe0CWBGHSw== 2022-09-17T10:27:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.e] 2022-09-17T10:27:14.520 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVji4wJMxAAS/uMvalG3IYlwpb6FYMPdA== 2022-09-17T10:27:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.h] 2022-09-17T10:27:14.521 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVjAhH3ORAAUpw2opYpfFrU4hz1BvUuTQ== 2022-09-17T10:27:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.k] 2022-09-17T10:27:14.521 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDToCVjQjscBRAAzyJQm3+Ap0aleZJrO/VuQA== 2022-09-17T10:27:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.1] 2022-09-17T10:27:14.521 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDloCVjCAiYLRAAjjZsAQg0lgg5ROycZp85sg== 2022-09-17T10:27:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.4] 2022-09-17T10:27:14.522 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDooCVj1xMvKxAAzTuJi5ruqLS3UKBbImua1A== 2022-09-17T10:27:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.7] 2022-09-17T10:27:14.522 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDroCVj4NEzLBAAWpNoNGTeAJxhaFAj6MNtwQ== 2022-09-17T10:27:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.10] 2022-09-17T10:27:14.523 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDuoCVjNHxzKhAAeL9QXIZpu7+Y+qs7tSNqJw== 2022-09-17T10:27:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.z] 2022-09-17T10:27:14.523 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSoCVjgqasDhAALErVDBITnAgIJl0axzokVw== 2022-09-17T10:27:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2022-09-17T10:27:14.524 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDToCVji1D5CRAAvBA4fE9+ruzBkSsA3AYMyQ== 2022-09-17T10:27:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.f] 2022-09-17T10:27:14.524 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDToCVj7yoxERAA56sDfjQRbj0j4zsC/3Bt7A== 2022-09-17T10:27:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.i] 2022-09-17T10:27:14.525 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDToCVjuuwqGBAAVHOCl0ZO4HClt2GRdFcmiA== 2022-09-17T10:27:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.l] 2022-09-17T10:27:14.525 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDToCVjCWkRHxAAYwUguP9sgKibmyxawJfHvg== 2022-09-17T10:27:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.2] 2022-09-17T10:27:14.526 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD0oCVjJEakLhAAZlqHtA5gAWi0UbVEfh98Dw== 2022-09-17T10:27:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.5] 2022-09-17T10:27:14.526 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD3oCVjDIWYLxAAUuKrLtHs5PUYXdQY2niSIw== 2022-09-17T10:27:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.8] 2022-09-17T10:27:14.527 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD6oCVjRYVlLRAAmelzxqUgr6Hf8XfvtmKR6g== 2022-09-17T10:27:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.11] 2022-09-17T10:27:14.527 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD9oCVjYUxfLhAAckxtup17xphTVzny2LZFjA== 2022-09-17T10:27:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2022-09-17T10:27:14.527 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDToCVjz3LnIxAA0j8pucppSDEvZJO1salT0Q== 2022-09-17T10:27:14.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:14.531 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:14.534 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:14.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.589 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.592 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.646 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.704 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.707 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.765 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:14.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:14.877 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:14.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:14.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:14.949 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:14.971 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.031 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.058 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.116 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.146 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:15.196 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:15.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:15.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.249 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.258 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.342 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.391 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.395 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.398 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.450 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.453 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.507 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.509 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.564 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.597 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.649 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.682 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.730 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.735 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.769 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:15.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:15.820 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:15.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-17T10:27:15.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.874 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.910 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.963 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:15.967 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:16.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:16.020 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:16.026 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:16.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:16.077 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:16.080 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-17T10:27:16.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.137 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.140 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.189 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.193 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.243 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.278 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.328 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-17T10:27:16.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-17T10:27:16.393 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-17T10:27:16.397 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-17T10:27:16.447 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-09-17T10:27:16.448 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-09-17T10:27:16.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-17T10:27:16.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-09-17T10:27:16.616 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-09-17T10:27:16.643 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-17T10:27:16.733 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-09-17T10:27:16.757 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-09-17T10:27:16.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-17T10:27:16.876 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-09-17T10:27:16.903 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:27:16.907 DEBUG:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:27:16.913 DEBUG:teuthology.orchestra.run.smithi159:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-09-17T10:27:16.959 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-09-17T10:27:16.960 INFO:tasks.ceph.mon.a:Restarting daemon 2022-09-17T10:27:16.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-09-17T10:27:16.965 INFO:tasks.ceph.mon.a:Started 2022-09-17T10:27:16.966 INFO:tasks.ceph.mon.b:Restarting daemon 2022-09-17T10:27:16.966 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-09-17T10:27:16.969 INFO:tasks.ceph.mon.b:Started 2022-09-17T10:27:16.969 INFO:tasks.ceph.mon.c:Restarting daemon 2022-09-17T10:27:16.970 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-09-17T10:27:17.005 INFO:tasks.ceph.mon.c:Started 2022-09-17T10:27:17.006 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-09-17T10:27:17.007 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-09-17T10:27:17.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-09-17T10:27:17.010 INFO:tasks.ceph.mgr.x:Started 2022-09-17T10:27:17.010 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-09-17T10:27:17.011 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-09-17T10:27:17.017 INFO:tasks.ceph.mgr.y:Started 2022-09-17T10:27:17.018 INFO:tasks.ceph.mgr.z:Restarting daemon 2022-09-17T10:27:17.018 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2022-09-17T10:27:17.021 INFO:tasks.ceph.mgr.z:Started 2022-09-17T10:27:17.022 INFO:tasks.ceph:Setting crush tunables to default 2022-09-17T10:27:17.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2022-09-17T10:27:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.138+0000 7fa10358c700 1 Processor -- start 2022-09-17T10:27:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.138+0000 7fa10358c700 1 -- start start 2022-09-17T10:27:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.139+0000 7fa10358c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.139+0000 7fa10358c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.139+0000 7fa10358c700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc0c6dd0 con 0x7fa0fc1751b0 2022-09-17T10:27:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.139+0000 7fa10358c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc0f10e0 con 0x7fa0fc175590 2022-09-17T10:27:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.139+0000 7fa10358c700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc1801e0 con 0x7fa0fc0ef650 2022-09-17T10:27:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa100b27700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa100b27700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55662/0 (socket says 172.21.15.62:55662) 2022-09-17T10:27:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 learned_addr learned my addr 172.21.15.62:0/998604844 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-17T10:27:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-09-17T10:27:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-09-17T10:27:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.140+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-09-17T10:27:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-09-17T10:27:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-09-17T10:27:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-17T10:27:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.341+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-09-17T10:27:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-17T10:27:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-09-17T10:27:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-09-17T10:27:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:17.742+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-09-17T10:27:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-17T10:27:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa100b27700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-09-17T10:27:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-09-17T10:27:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:18.552 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:18.543+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-09-17T10:27:20.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 msgr2=0x7fa0fc0efa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-17T10:27:20.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.159:3300/0 conn(0x7fa0fc0ef650 0x7fa0fc0efa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:20.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 msgr2=0x7fa0fc180d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-17T10:27:20.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.62:3300/0 conn(0x7fa0fc175590 0x7fa0fc180d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:20.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 -- 172.21.15.62:0/998604844 >> v1:172.21.15.159:6789/0 conn(0x7fa0fc1751b0 legacy=0x7fa0fc180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:20.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 -- 172.21.15.62:0/998604844 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc0f0840 con 0x7fa0dc006060 2022-09-17T10:27:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 -- 172.21.15.62:0/998604844 --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc00eb90 con 0x7fa0dc009df0 2022-09-17T10:27:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa0faffd700 1 -- 172.21.15.62:0/998604844 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc0f10e0 con 0x7fa0dc003590 2022-09-17T10:27:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-17T10:27:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.140+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-09-17T10:27:20.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.341+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.341+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-17T10:27:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.341+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.341+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.341+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-09-17T10:27:20.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.742+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.742+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-17T10:27:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.742+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:20.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.742+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:20.742+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-09-17T10:27:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:21.543+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:21.547 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:21.544+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-17T10:27:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:21.544+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-17T10:27:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:21.544+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-09-17T10:27:21.548 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:21.544+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-09-17T10:27:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.325+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415681172 0 0) 0x7fa0fc0f0840 con 0x7fa0dc006060 2022-09-17T10:27:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.325+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e80033f0 con 0x7fa0dc006060 2022-09-17T10:27:22.341 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2673573978 0 0) 0x7fa0e80033f0 con 0x7fa0dc006060 2022-09-17T10:27:22.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 msgr2=0x7fa0dc0059c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-17T10:27:22.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 --2- 172.21.15.62:0/998604844 >> v2:172.21.15.93:3300/0 conn(0x7fa0dc003590 0x7fa0dc0059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 >> v1:172.21.15.93:6789/0 conn(0x7fa0dc009df0 legacy=0x7fa0dc00c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:22.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc00fe10 con 0x7fa0dc006060 2022-09-17T10:27:22.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa101b29700 1 -- 172.21.15.62:0/998604844 reap_dead start 2022-09-17T10:27:22.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7fa0f000d300 con 0x7fa0dc006060 2022-09-17T10:27:22.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 >> v1:172.21.15.62:6789/0 conn(0x7fa0dc006060 legacy=0x7fa0dc008520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:22.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e80038e0 0x7fa0e8003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:22.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0e8004690 0x7fa0e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:22.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e8005070 0x7fa0e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:22.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc0f10e0 con 0x7fa0e8005070 2022-09-17T10:27:22.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e800c010 con 0x7fa0e8004690 2022-09-17T10:27:22.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e800c1d0 con 0x7fa0e80038e0 2022-09-17T10:27:22.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e80038e0 0x7fa0e8003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:22.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0e8004690 0x7fa0e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:22.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.327+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e8005070 0x7fa0e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:22.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.328+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0e8004690 msgr2=0x7fa0e8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:22.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.328+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0e8004690 0x7fa0e8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.328+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e8005070 msgr2=0x7fa0e800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.328+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e8005070 0x7fa0e800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.328+0000 7fa101328700 1 -- 172.21.15.62:0/998604844 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80033f0 con 0x7fa0e80038e0 2022-09-17T10:27:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.328+0000 7fa100b27700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0e8004690 0x7fa0e8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.328+0000 7fa101b29700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e8005070 0x7fa0e800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.328+0000 7fa101328700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e80038e0 0x7fa0e8003cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fa0f4007b50 tx=0x7fa0f4009040).ready entity=mon.2 client_cookie=d689e52c942570ea server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.329+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40144f0 con 0x7fa0e80038e0 2022-09-17T10:27:22.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.329+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f4014650 con 0x7fa0e80038e0 2022-09-17T10:27:22.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.329+0000 7fa0fbfff700 1 -- 172.21.15.62:0/998604844 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40147c0 con 0x7fa0e80038e0 2022-09-17T10:27:22.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 -- 172.21.15.62:0/998604844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e80038e0 msgr2=0x7fa0e8003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:22.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e80038e0 0x7fa0e8003cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fa0f4007b50 tx=0x7fa0f4009040).stop 2022-09-17T10:27:22.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 -- 172.21.15.62:0/998604844 shutdown_connections 2022-09-17T10:27:22.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0e8004690 0x7fa0e8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e8005070 0x7fa0e800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 --2- 172.21.15.62:0/998604844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e80038e0 0x7fa0e8003cc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 -- 172.21.15.62:0/998604844 >> 172.21.15.62:0/998604844 conn(0x7fa0fc06a170 msgr2=0x7fa0fc0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:22.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 -- 172.21.15.62:0/998604844 shutdown_connections 2022-09-17T10:27:22.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.330+0000 7fa10358c700 1 -- 172.21.15.62:0/998604844 wait complete. 2022-09-17T10:27:22.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.332+0000 7fa10358c700 1 Processor -- start 2022-09-17T10:27:22.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.332+0000 7fa10358c700 1 -- start start 2022-09-17T10:27:22.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa10358c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0dc006060 0x7fa0fc0f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:22.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa10358c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e80038e0 0x7fa0fc0ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:22.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa10358c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e8004690 0x7fa0fc062fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:22.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa10358c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc0ed450 con 0x7fa0e80038e0 2022-09-17T10:27:22.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa10358c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc0ee540 con 0x7fa0dc006060 2022-09-17T10:27:22.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa10358c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc0ed650 con 0x7fa0e8004690 2022-09-17T10:27:22.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101328700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0dc006060 0x7fa0fc0f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:22.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa100b27700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e80038e0 0x7fa0fc0ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:22.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101328700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0dc006060 0x7fa0fc0f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.62:49710/0 (socket says 172.21.15.62:49710) 2022-09-17T10:27:22.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101b29700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e8004690 0x7fa0fc062fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:22.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101328700 1 -- 172.21.15.62:0/682183364 learned_addr learned my addr 172.21.15.62:0/682183364 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:22.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101b29700 1 -- 172.21.15.62:0/682183364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0dc006060 msgr2=0x7fa0fc0f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:22.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101b29700 1 --2- 172.21.15.62:0/682183364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0dc006060 0x7fa0fc0f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101b29700 1 -- 172.21.15.62:0/682183364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e80038e0 msgr2=0x7fa0fc0ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:22.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101b29700 1 --2- 172.21.15.62:0/682183364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e80038e0 0x7fa0fc0ecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.334+0000 7fa101b29700 1 -- 172.21.15.62:0/682183364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc0ed930 con 0x7fa0e8004690 2022-09-17T10:27:22.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.335+0000 7fa101b29700 1 --2- 172.21.15.62:0/682183364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e8004690 0x7fa0fc062fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa0fc0ef2d0 tx=0x7fa0ec00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:22.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.335+0000 7fa0f97fa700 1 -- 172.21.15.62:0/682183364 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec014e70 con 0x7fa0e8004690 2022-09-17T10:27:22.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.335+0000 7fa0f97fa700 1 -- 172.21.15.62:0/682183364 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec00f040 con 0x7fa0e8004690 2022-09-17T10:27:22.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.335+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc0edc10 con 0x7fa0e8004690 2022-09-17T10:27:22.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.335+0000 7fa0f97fa700 1 -- 172.21.15.62:0/682183364 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec012dc0 con 0x7fa0e8004690 2022-09-17T10:27:22.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.335+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc0ee1d0 con 0x7fa0e8004690 2022-09-17T10:27:22.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.336+0000 7fa0f97fa700 1 -- 172.21.15.62:0/682183364 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fa0ec0178b0 con 0x7fa0e8004690 2022-09-17T10:27:22.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.336+0000 7fa0f97fa700 1 -- 172.21.15.62:0/682183364 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fa0ec022610 con 0x7fa0e8004690 2022-09-17T10:27:22.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.337+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0fc06bf40 con 0x7fa0e8004690 2022-09-17T10:27:22.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.341+0000 7fa0f97fa700 1 -- 172.21.15.62:0/682183364 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7fa0ec017d90 con 0x7fa0e8004690 2022-09-17T10:27:22.424 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.421+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa0fc0ee680 con 0x7fa0e8004690 2022-09-17T10:27:22.429 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.427+0000 7fa0f97fa700 1 -- 172.21.15.62:0/682183364 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa0ec022930 con 0x7fa0e8004690 2022-09-17T10:27:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e8004690 msgr2=0x7fa0fc062fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 --2- 172.21.15.62:0/682183364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e8004690 0x7fa0fc062fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa0fc0ef2d0 tx=0x7fa0ec00b040).stop 2022-09-17T10:27:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 shutdown_connections 2022-09-17T10:27:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 --2- 172.21.15.62:0/682183364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0dc006060 0x7fa0fc0f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 --2- 172.21.15.62:0/682183364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e8004690 0x7fa0fc062fc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 --2- 172.21.15.62:0/682183364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e80038e0 0x7fa0fc0ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 >> 172.21.15.62:0/682183364 conn(0x7fa0fc06a170 msgr2=0x7fa0fc0efe00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 shutdown_connections 2022-09-17T10:27:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:22.428+0000 7fa10358c700 1 -- 172.21.15.62:0/682183364 wait complete. 2022-09-17T10:27:22.439 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2022-09-17T10:27:22.443 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-09-17T10:27:22.444 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:22.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-09-17T10:27:22.470 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:22.467+0000 7f63a4644680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-17T10:27:22.471 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:22.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-09-17T10:27:22.476 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:22.473+0000 7f414c034680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-17T10:27:22.485 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:22.482+0000 7f3248a31680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-17T10:27:22.512 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:22.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-09-17T10:27:22.538 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:22.535+0000 7f63a4644680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-17T10:27:22.543 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:22.541+0000 7f414c034680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-17T10:27:22.559 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:22.556+0000 7f3248a31680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-17T10:27:22.577 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:27:22.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2022-09-17T10:27:22.646 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:22.647 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-09-17T10:27:22.674 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:22.674 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-09-17T10:27:22.742 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:22.742 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-09-17T10:27:22.806 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2022-09-17T10:27:22.807 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2022-09-17T10:27:22.872 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:22.873 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-09-17T10:27:22.898 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:22.898 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-09-17T10:27:22.947 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:22.945+0000 7f63a4644680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-17T10:27:22.952 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:22.949+0000 7f414c034680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-17T10:27:22.964 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:22.965 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2022-09-17T10:27:22.991 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:22.985+0000 7f3248a31680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-17T10:27:23.030 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2022-09-17T10:27:23.030 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2022-09-17T10:27:23.102 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 3a2cd6a0-794c-4556-a111-e8ccfef84dce 0 2022-09-17T10:27:23.255 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.252+0000 7f54b53db700 1 Processor -- start 2022-09-17T10:27:23.255 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.252+0000 7f54b53db700 1 -- start start 2022-09-17T10:27:23.259 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54b53db700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f54b015a0f0 0x7f54b015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.259 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54b53db700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00e4ad0 0x7f54b00e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.259 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54b53db700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b00e5580 con 0x7f54b00eaac0 2022-09-17T10:27:23.260 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54b53db700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b00e6100 con 0x7f54b00e4ad0 2022-09-17T10:27:23.260 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54b53db700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b00e5860 con 0x7f54b015a0f0 2022-09-17T10:27:23.260 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54aeffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f54b015a0f0 0x7f54b015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.261 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54af7fe700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f54b00eaac0 0x7f54b00eaf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:47904/0 (socket says 172.21.15.159:47904) 2022-09-17T10:27:23.261 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54af7fe700 1 -- 172.21.15.159:0/352368585 learned_addr learned my addr 172.21.15.159:0/352368585 (peer_addr_for_me v1:172.21.15.159:0/0) 2022-09-17T10:27:23.261 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.253+0000 7f54ae7fc700 1 --2- 172.21.15.159:0/352368585 >> v2:172.21.15.93:3300/0 conn(0x7f54b00e4ad0 0x7f54b00e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.261 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54aeffd700 1 -- 172.21.15.159:0/352368585 >> v2:172.21.15.93:3300/0 conn(0x7f54b00e4ad0 msgr2=0x7f54b00e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:23.262 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54aeffd700 1 --2- 172.21.15.159:0/352368585 >> v2:172.21.15.93:3300/0 conn(0x7f54b00e4ad0 0x7f54b00e4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.262 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54aeffd700 1 -- 172.21.15.159:0/352368585 >> v1:172.21.15.159:6789/0 conn(0x7f54b00eaac0 legacy=0x7f54b00eaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.262 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54aeffd700 1 -- 172.21.15.159:0/352368585 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00e5b40 con 0x7f54b015a0f0 2022-09-17T10:27:23.262 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54adffb700 1 -- 172.21.15.159:0/352368585 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589240999 0 0) 0x7f54b00e5580 con 0x7f54b00eaac0 2022-09-17T10:27:23.263 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54ae7fc700 1 --2- 172.21.15.159:0/352368585 >> v2:172.21.15.93:3300/0 conn(0x7f54b00e4ad0 0x7f54b00e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:23.263 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54aeffd700 1 --2- 172.21.15.159:0/352368585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b015a0f0 0x7f54b015a4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f54b00ef5c0 tx=0x7f54a4009060).ready entity=mon.2 client_cookie=aae2cf5875acf58f server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:23.263 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54adffb700 1 -- 172.21.15.159:0/352368585 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400b580 con 0x7f54b015a0f0 2022-09-17T10:27:23.263 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54adffb700 1 -- 172.21.15.159:0/352368585 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400b6e0 con 0x7f54b015a0f0 2022-09-17T10:27:23.264 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54adffb700 1 -- 172.21.15.159:0/352368585 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400ba60 con 0x7f54b015a0f0 2022-09-17T10:27:23.264 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54b53db700 1 -- 172.21.15.159:0/352368585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b015a0f0 msgr2=0x7f54b015a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.264 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54b53db700 1 --2- 172.21.15.159:0/352368585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b015a0f0 0x7f54b015a4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f54b00ef5c0 tx=0x7f54a4009060).stop 2022-09-17T10:27:23.264 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54b53db700 1 -- 172.21.15.159:0/352368585 shutdown_connections 2022-09-17T10:27:23.265 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54b53db700 1 --2- 172.21.15.159:0/352368585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b015a0f0 0x7f54b015a4d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.265 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54b53db700 1 --2- 172.21.15.159:0/352368585 >> v2:172.21.15.93:3300/0 conn(0x7f54b00e4ad0 0x7f54b00e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.265 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54b53db700 1 -- 172.21.15.159:0/352368585 >> 172.21.15.159:0/352368585 conn(0x7f54b005e460 msgr2=0x7f54b00ecda0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:23.265 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54b53db700 1 -- 172.21.15.159:0/352368585 shutdown_connections 2022-09-17T10:27:23.266 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.254+0000 7f54b53db700 1 -- 172.21.15.159:0/352368585 wait complete. 2022-09-17T10:27:23.266 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.256+0000 7f54b53db700 1 Processor -- start 2022-09-17T10:27:23.266 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.256+0000 7f54b53db700 1 -- start start 2022-09-17T10:27:23.269 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54b53db700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00e4ad0 0x7f54b0181680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.270 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54b53db700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54b00eaac0 0x7f54b018fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.270 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54b53db700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54b015a0f0 0x7f54b0176b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.270 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54b53db700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b01811f0 con 0x7f54b00eaac0 2022-09-17T10:27:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54b53db700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0181b70 con 0x7f54b015a0f0 2022-09-17T10:27:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54b53db700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00e15d0 con 0x7f54b00e4ad0 2022-09-17T10:27:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00e4ad0 0x7f54b0181680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00e4ad0 0x7f54b0181680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37758/0 (socket says 172.21.15.159:37758) 2022-09-17T10:27:23.272 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 -- 172.21.15.159:0/3531063847 learned_addr learned my addr 172.21.15.159:0/3531063847 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:23.272 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54af7fe700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54b015a0f0 0x7f54b0176b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.272 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54ae7fc700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54b00eaac0 0x7f54b018fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.272 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 -- 172.21.15.159:0/3531063847 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54b015a0f0 msgr2=0x7f54b0176b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.273 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54b015a0f0 0x7f54b0176b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.273 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 -- 172.21.15.159:0/3531063847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54b00eaac0 msgr2=0x7f54b018fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.273 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54b00eaac0 0x7f54b018fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.273 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 -- 172.21.15.159:0/3531063847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a40092a0 con 0x7f54b00e4ad0 2022-09-17T10:27:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.257+0000 7f54aeffd700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00e4ad0 0x7f54b0181680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f54a4009fd0 tx=0x7f54a4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.258+0000 7f5496ffd700 1 -- 172.21.15.159:0/3531063847 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4000bc0 con 0x7f54b00e4ad0 2022-09-17T10:27:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.258+0000 7f5496ffd700 1 -- 172.21.15.159:0/3531063847 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400b850 con 0x7f54b00e4ad0 2022-09-17T10:27:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.258+0000 7f5496ffd700 1 -- 172.21.15.159:0/3531063847 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4000d20 con 0x7f54b00e4ad0 2022-09-17T10:27:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.258+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b01808c0 con 0x7f54b00e4ad0 2022-09-17T10:27:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.258+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b0180e80 con 0x7f54b00e4ad0 2022-09-17T10:27:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.258+0000 7f5496ffd700 1 -- 172.21.15.159:0/3531063847 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f54a402a070 con 0x7f54b00e4ad0 2022-09-17T10:27:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.258+0000 7f5496ffd700 1 -- 172.21.15.159:0/3531063847 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f54a4023800 con 0x7f54b00e4ad0 2022-09-17T10:27:23.276 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.258+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b0180640 con 0x7f54b00e4ad0 2022-09-17T10:27:23.276 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.261+0000 7f5496ffd700 1 -- 172.21.15.159:0/3531063847 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f54a4042de0 con 0x7f54b00e4ad0 2022-09-17T10:27:23.342 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.339+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3a2cd6a0-794c-4556-a111-e8ccfef84dce", "id": 0} v 0) v1 -- 0x7f54b006be90 con 0x7f54b00e4ad0 2022-09-17T10:27:23.350 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.347+0000 7f5496ffd700 1 -- 172.21.15.159:0/3531063847 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a2cd6a0-794c-4556-a111-e8ccfef84dce", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54a4031070 con 0x7f54b00e4ad0 2022-09-17T10:27:23.350 INFO:teuthology.orchestra.run.smithi159.stdout:0 2022-09-17T10:27:23.351 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00e4ad0 msgr2=0x7f54b0181680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00e4ad0 0x7f54b0181680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f54a4009fd0 tx=0x7f54a4017000).stop 2022-09-17T10:27:23.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 shutdown_connections 2022-09-17T10:27:23.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54b015a0f0 0x7f54b0176b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.352 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b00e4ad0 0x7f54b0181680 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.353 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 --2- 172.21.15.159:0/3531063847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54b00eaac0 0x7f54b018fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.353 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 >> 172.21.15.159:0/3531063847 conn(0x7f54b005e460 msgr2=0x7f54b017c050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:23.353 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 shutdown_connections 2022-09-17T10:27:23.354 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.348+0000 7f54b53db700 1 -- 172.21.15.159:0/3531063847 wait complete. 2022-09-17T10:27:23.362 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 5f3b4267-d29c-46af-ae7f-766c76955a4e 1 2022-09-17T10:27:23.477 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.473+0000 7fb414516700 1 Processor -- start 2022-09-17T10:27:23.477 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.473+0000 7fb414516700 1 -- start start 2022-09-17T10:27:23.484 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb414516700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb40c176220 0x7fb40c0e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.485 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb414516700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb40c083ee0 0x7fb40c084370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.485 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb414516700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40c0e9b40 con 0x7fb40c176600 2022-09-17T10:27:23.486 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb414516700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c17f700 con 0x7fb40c083ee0 2022-09-17T10:27:23.486 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb414516700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c0e8f70 con 0x7fb40c176220 2022-09-17T10:27:23.486 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb4122b2700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb40c176220 0x7fb40c0e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.487 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb4122b2700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb40c176220 0x7fb40c0e9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37772/0 (socket says 172.21.15.159:37772) 2022-09-17T10:27:23.487 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb4122b2700 1 -- 172.21.15.159:0/352690067 learned_addr learned my addr 172.21.15.159:0/352690067 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:23.487 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb412ab3700 1 --2- 172.21.15.159:0/352690067 >> v2:172.21.15.93:3300/0 conn(0x7fb40c083ee0 0x7fb40c084370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.488 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb4122b2700 1 -- 172.21.15.159:0/352690067 >> v2:172.21.15.93:3300/0 conn(0x7fb40c083ee0 msgr2=0x7fb40c084370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:23.488 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb4122b2700 1 --2- 172.21.15.159:0/352690067 >> v2:172.21.15.93:3300/0 conn(0x7fb40c083ee0 0x7fb40c084370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.489 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb4122b2700 1 -- 172.21.15.159:0/352690067 >> v1:172.21.15.62:6789/0 conn(0x7fb40c176600 legacy=0x7fb40c0ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.489 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb4122b2700 1 -- 172.21.15.159:0/352690067 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c0e9210 con 0x7fb40c176220 2022-09-17T10:27:23.490 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.475+0000 7fb4122b2700 1 --2- 172.21.15.159:0/352690067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176220 0x7fb40c0e9fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb40c086210 tx=0x7fb3fc0090f0).ready entity=mon.2 client_cookie=818c1da625aed469 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:23.490 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb4112b0700 1 -- 172.21.15.159:0/352690067 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00b520 con 0x7fb40c176220 2022-09-17T10:27:23.491 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb4112b0700 1 -- 172.21.15.159:0/352690067 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc00b680 con 0x7fb40c176220 2022-09-17T10:27:23.491 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb4112b0700 1 -- 172.21.15.159:0/352690067 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00ba00 con 0x7fb40c176220 2022-09-17T10:27:23.491 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb414516700 1 -- 172.21.15.159:0/352690067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176220 msgr2=0x7fb40c0e9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.491 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb414516700 1 --2- 172.21.15.159:0/352690067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176220 0x7fb40c0e9fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb40c086210 tx=0x7fb3fc0090f0).stop 2022-09-17T10:27:23.492 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb414516700 1 -- 172.21.15.159:0/352690067 shutdown_connections 2022-09-17T10:27:23.492 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb414516700 1 --2- 172.21.15.159:0/352690067 >> v2:172.21.15.93:3300/0 conn(0x7fb40c083ee0 0x7fb40c084370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.492 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb414516700 1 --2- 172.21.15.159:0/352690067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176220 0x7fb40c0e9fd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.492 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb414516700 1 -- 172.21.15.159:0/352690067 >> 172.21.15.159:0/352690067 conn(0x7fb40c0eeea0 msgr2=0x7fb40c05d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:23.493 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb414516700 1 -- 172.21.15.159:0/352690067 shutdown_connections 2022-09-17T10:27:23.493 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.476+0000 7fb414516700 1 -- 172.21.15.159:0/352690067 wait complete. 2022-09-17T10:27:23.493 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.478+0000 7fb414516700 1 Processor -- start 2022-09-17T10:27:23.493 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.478+0000 7fb414516700 1 -- start start 2022-09-17T10:27:23.494 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb414516700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb40c083ee0 0x7fb40c190060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.494 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb414516700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb40c176220 0x7fb40c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.494 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb414516700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176600 0x7fb40c17ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.494 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb414516700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c16ec10 con 0x7fb40c176220 2022-09-17T10:27:23.495 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb414516700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c17b5e0 con 0x7fb40c083ee0 2022-09-17T10:27:23.495 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb414516700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c15f9f0 con 0x7fb40c176600 2022-09-17T10:27:23.495 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176600 0x7fb40c17ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.495 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176600 0x7fb40c17ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37778/0 (socket says 172.21.15.159:37778) 2022-09-17T10:27:23.496 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 -- 172.21.15.159:0/331721024 learned_addr learned my addr 172.21.15.159:0/331721024 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:23.496 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb4122b2700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb40c083ee0 0x7fb40c190060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.497 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb411ab1700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb40c176220 0x7fb40c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.497 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 -- 172.21.15.159:0/331721024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb40c083ee0 msgr2=0x7fb40c190060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.498 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb40c083ee0 0x7fb40c190060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.498 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 -- 172.21.15.159:0/331721024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb40c176220 msgr2=0x7fb40c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.498 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb40c176220 0x7fb40c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.498 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 -- 172.21.15.159:0/331721024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc009370 con 0x7fb40c176600 2022-09-17T10:27:23.499 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.479+0000 7fb412ab3700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176600 0x7fb40c17ba70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb404009ec0 tx=0x7fb40400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:23.500 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.480+0000 7fb3fa7fc700 1 -- 172.21.15.159:0/331721024 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400cb10 con 0x7fb40c176600 2022-09-17T10:27:23.500 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.480+0000 7fb3fa7fc700 1 -- 172.21.15.159:0/331721024 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40400f040 con 0x7fb40c176600 2022-09-17T10:27:23.500 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.480+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40c17a9d0 con 0x7fb40c176600 2022-09-17T10:27:23.501 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.480+0000 7fb3fa7fc700 1 -- 172.21.15.159:0/331721024 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400ce80 con 0x7fb40c176600 2022-09-17T10:27:23.501 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.480+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40c17af90 con 0x7fb40c176600 2022-09-17T10:27:23.501 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.480+0000 7fb3fa7fc700 1 -- 172.21.15.159:0/331721024 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fb404013870 con 0x7fb40c176600 2022-09-17T10:27:23.502 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.480+0000 7fb3fa7fc700 1 -- 172.21.15.159:0/331721024 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fb40401d9f0 con 0x7fb40c176600 2022-09-17T10:27:23.502 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.481+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40c06bf40 con 0x7fb40c176600 2022-09-17T10:27:23.503 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.483+0000 7fb3fa7fc700 1 -- 172.21.15.159:0/331721024 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7fb404013ce0 con 0x7fb40c176600 2022-09-17T10:27:23.565 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.562+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5f3b4267-d29c-46af-ae7f-766c76955a4e", "id": 1} v 0) v1 -- 0x7fb40c0e94f0 con 0x7fb40c176600 2022-09-17T10:27:23.572 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.570+0000 7fb3fa7fc700 1 -- 172.21.15.159:0/331721024 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f3b4267-d29c-46af-ae7f-766c76955a4e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb40401dc30 con 0x7fb40c176600 2022-09-17T10:27:23.573 INFO:teuthology.orchestra.run.smithi159.stdout:1 2022-09-17T10:27:23.574 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176600 msgr2=0x7fb40c17ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.575 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176600 0x7fb40c17ba70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb404009ec0 tx=0x7fb40400b040).stop 2022-09-17T10:27:23.575 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 shutdown_connections 2022-09-17T10:27:23.575 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb40c083ee0 0x7fb40c190060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.575 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb40c176600 0x7fb40c17ba70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.575 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 --2- 172.21.15.159:0/331721024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb40c176220 0x7fb40c15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.576 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 >> 172.21.15.159:0/331721024 conn(0x7fb40c0eeea0 msgr2=0x7fb40c0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:23.576 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 shutdown_connections 2022-09-17T10:27:23.576 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.571+0000 7fb414516700 1 -- 172.21.15.159:0/331721024 wait complete. 2022-09-17T10:27:23.586 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 1ee5fe22-6b92-4c34-8dd6-81c56f857f41 2 2022-09-17T10:27:23.663 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:23.662+0000 7f414c034680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-17T10:27:23.717 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:23.714+0000 7f63a4644680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-17T10:27:23.724 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.721+0000 7f05396ac700 1 Processor -- start 2022-09-17T10:27:23.725 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.721+0000 7f05396ac700 1 -- start start 2022-09-17T10:27:23.731 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:23.726+0000 7f414c034680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-17T10:27:23.744 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.722+0000 7f05396ac700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0534174ac0 0x7f05340e8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.745 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.722+0000 7f05396ac700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0534179f40 con 0x7f0534174ea0 2022-09-17T10:27:23.745 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.722+0000 7f05396ac700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340e8af0 con 0x7f0534178840 2022-09-17T10:27:23.746 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.722+0000 7f05396ac700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053417aae0 con 0x7f0534174ac0 2022-09-17T10:27:23.746 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.722+0000 7f0532ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0534174ac0 0x7f05340e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.747 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.722+0000 7f0532ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0534174ac0 0x7f05340e8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37788/0 (socket says 172.21.15.159:37788) 2022-09-17T10:27:23.747 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.722+0000 7f05337fe700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f0534178840 0x7f053417a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:47916/0 (socket says 172.21.15.159:47916) 2022-09-17T10:27:23.748 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.722+0000 7f0532ffd700 1 -- 172.21.15.159:0/1283978824 learned_addr learned my addr 172.21.15.159:0/1283978824 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:23.748 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f0532ffd700 1 -- 172.21.15.159:0/1283978824 >> v1:172.21.15.159:6789/0 conn(0x7f0534178840 legacy=0x7f053417a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.748 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f0532ffd700 1 -- 172.21.15.159:0/1283978824 >> v1:172.21.15.62:6789/0 conn(0x7f0534174ea0 legacy=0x7f05340ec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.749 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f0531ffb700 1 -- 172.21.15.159:0/1283978824 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572168771 0 0) 0x7f05340e8af0 con 0x7f0534178840 2022-09-17T10:27:23.750 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f0532ffd700 1 -- 172.21.15.159:0/1283978824 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534179050 con 0x7f0534174ac0 2022-09-17T10:27:23.750 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f0532ffd700 1 --2- 172.21.15.159:0/1283978824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534174ac0 0x7f05340e8600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0528006fd0 tx=0x7f05280090f0).ready entity=mon.2 client_cookie=63c6220a3ab2a37a server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:23.751 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f0531ffb700 1 -- 172.21.15.159:0/1283978824 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800b600 con 0x7f0534174ac0 2022-09-17T10:27:23.751 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f0531ffb700 1 -- 172.21.15.159:0/1283978824 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052800b760 con 0x7f0534174ac0 2022-09-17T10:27:23.752 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f0531ffb700 1 -- 172.21.15.159:0/1283978824 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800bae0 con 0x7f0534174ac0 2022-09-17T10:27:23.752 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f05396ac700 1 -- 172.21.15.159:0/1283978824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534174ac0 msgr2=0x7f05340e8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.752 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f05396ac700 1 --2- 172.21.15.159:0/1283978824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534174ac0 0x7f05340e8600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0528006fd0 tx=0x7f05280090f0).stop 2022-09-17T10:27:23.753 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f05396ac700 1 -- 172.21.15.159:0/1283978824 shutdown_connections 2022-09-17T10:27:23.753 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.723+0000 7f05396ac700 1 --2- 172.21.15.159:0/1283978824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534174ac0 0x7f05340e8600 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.754 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.724+0000 7f05396ac700 1 -- 172.21.15.159:0/1283978824 >> 172.21.15.159:0/1283978824 conn(0x7f05340f1c10 msgr2=0x7f05340edbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:23.754 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.724+0000 7f05396ac700 1 -- 172.21.15.159:0/1283978824 shutdown_connections 2022-09-17T10:27:23.755 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.724+0000 7f05396ac700 1 -- 172.21.15.159:0/1283978824 wait complete. 2022-09-17T10:27:23.755 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.725+0000 7f05396ac700 1 Processor -- start 2022-09-17T10:27:23.755 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.725+0000 7f05396ac700 1 -- start start 2022-09-17T10:27:23.756 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05396ac700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0534174ac0 0x7f0534169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.756 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05396ac700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0534174ea0 0x7f0534190970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.757 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05396ac700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534178840 0x7f05340c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.757 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05396ac700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053418f370 con 0x7f0534174ac0 2022-09-17T10:27:23.758 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05396ac700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053418f650 con 0x7f0534174ea0 2022-09-17T10:27:23.758 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05396ac700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053418f930 con 0x7f0534178840 2022-09-17T10:27:23.759 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05337fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534178840 0x7f05340c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.759 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05337fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534178840 0x7f05340c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37792/0 (socket says 172.21.15.159:37792) 2022-09-17T10:27:23.760 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05337fe700 1 -- 172.21.15.159:0/3197408207 learned_addr learned my addr 172.21.15.159:0/3197408207 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:23.760 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f0532ffd700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0534174ac0 0x7f0534169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.761 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05327fc700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0534174ea0 0x7f0534190970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.761 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05337fe700 1 -- 172.21.15.159:0/3197408207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0534174ea0 msgr2=0x7f0534190970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.762 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05337fe700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0534174ea0 0x7f0534190970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.762 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05337fe700 1 -- 172.21.15.159:0/3197408207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0534174ac0 msgr2=0x7f0534169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.762 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.726+0000 7f05337fe700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0534174ac0 0x7f0534169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.763 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f05337fe700 1 -- 172.21.15.159:0/3197408207 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009370 con 0x7f0534178840 2022-09-17T10:27:23.764 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f05337fe700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534178840 0x7f05340c8120 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f052c00c810 tx=0x7f052c0014a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:23.764 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f051affd700 1 -- 172.21.15.159:0/3197408207 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c005c70 con 0x7f0534178840 2022-09-17T10:27:23.765 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f051affd700 1 -- 172.21.15.159:0/3197408207 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c005dd0 con 0x7f0534178840 2022-09-17T10:27:23.765 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053418fc10 con 0x7f0534178840 2022-09-17T10:27:23.766 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f051affd700 1 -- 172.21.15.159:0/3197408207 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c007320 con 0x7f0534178840 2022-09-17T10:27:23.766 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05340c7c00 con 0x7f0534178840 2022-09-17T10:27:23.767 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f051affd700 1 -- 172.21.15.159:0/3197408207 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f052c010070 con 0x7f0534178840 2022-09-17T10:27:23.767 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.727+0000 7f051affd700 1 -- 172.21.15.159:0/3197408207 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f052c013c60 con 0x7f0534178840 2022-09-17T10:27:23.768 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.728+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053406bf40 con 0x7f0534178840 2022-09-17T10:27:23.768 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.730+0000 7f051affd700 1 -- 172.21.15.159:0/3197408207 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f052c013810 con 0x7f0534178840 2022-09-17T10:27:23.769 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:23.737+0000 7f3248a31680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-17T10:27:23.786 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:23.784+0000 7f63a4644680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-17T10:27:23.809 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:23.806+0000 7f3248a31680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-17T10:27:23.812 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.809+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ee5fe22-6b92-4c34-8dd6-81c56f857f41", "id": 2} v 0) v1 -- 0x7f05340c42c0 con 0x7f0534178840 2022-09-17T10:27:23.820 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.817+0000 7f051affd700 1 -- 172.21.15.159:0/3197408207 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ee5fe22-6b92-4c34-8dd6-81c56f857f41", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f052c0139f0 con 0x7f0534178840 2022-09-17T10:27:23.821 INFO:teuthology.orchestra.run.smithi159.stdout:2 2022-09-17T10:27:23.822 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534178840 msgr2=0x7f05340c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.823 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534178840 0x7f05340c8120 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f052c00c810 tx=0x7f052c0014a0).stop 2022-09-17T10:27:23.823 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 shutdown_connections 2022-09-17T10:27:23.823 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0534178840 0x7f05340c8120 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.823 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0534174ac0 0x7f0534169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.824 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 --2- 172.21.15.159:0/3197408207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0534174ea0 0x7f0534190970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.824 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 >> 172.21.15.159:0/3197408207 conn(0x7f05340f1c10 msgr2=0x7f053417a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:23.824 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 shutdown_connections 2022-09-17T10:27:23.824 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.819+0000 7f05396ac700 1 -- 172.21.15.159:0/3197408207 wait complete. 2022-09-17T10:27:23.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 9278d65c-b17e-4045-adfc-d2e96019b1f0 3 2022-09-17T10:27:23.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:27:23.872 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:27:23.874 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:27:23.916 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:23.913+0000 7f414c034680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-17T10:27:23.956 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.953+0000 7faab486c700 1 Processor -- start 2022-09-17T10:27:23.957 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.953+0000 7faab486c700 1 -- start start 2022-09-17T10:27:23.968 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.954+0000 7faab486c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faab00cd4f0 0x7faab0186220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.969 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.954+0000 7faab486c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab00cd060 con 0x7faab0178940 2022-09-17T10:27:23.969 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faab486c700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab00cc170 con 0x7faab00f0d50 2022-09-17T10:27:23.969 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faab486c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab00cd980 con 0x7faab00cd4f0 2022-09-17T10:27:23.970 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaadd9b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7faab00f0d50 0x7faab00cb710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:47932/0 (socket says 172.21.15.159:47932) 2022-09-17T10:27:23.970 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaadd9b700 1 -- 172.21.15.159:0/3380451055 learned_addr learned my addr 172.21.15.159:0/3380451055 (peer_addr_for_me v1:172.21.15.159:0/0) 2022-09-17T10:27:23.970 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaaed9d700 1 --2- 172.21.15.159:0/3380451055 >> v2:172.21.15.62:3300/0 conn(0x7faab00cd4f0 0x7faab0186220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.971 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaad59a700 1 -- 172.21.15.159:0/3380451055 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224595609 0 0) 0x7faab00cc170 con 0x7faab00f0d50 2022-09-17T10:27:23.971 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaad59a700 1 -- 172.21.15.159:0/3380451055 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa940033f0 con 0x7faab00f0d50 2022-09-17T10:27:23.971 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaaed9d700 1 -- 172.21.15.159:0/3380451055 >> v1:172.21.15.159:6789/0 conn(0x7faab00f0d50 legacy=0x7faab00cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.971 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaad59a700 1 -- 172.21.15.159:0/3380451055 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188677423 0 0) 0x7faab00cd060 con 0x7faab0178940 2022-09-17T10:27:23.971 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaaed9d700 1 -- 172.21.15.159:0/3380451055 >> v1:172.21.15.62:6789/0 conn(0x7faab0178940 legacy=0x7faab017c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.972 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaaed9d700 1 -- 172.21.15.159:0/3380451055 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab00cc450 con 0x7faab00cd4f0 2022-09-17T10:27:23.972 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaaed9d700 1 --2- 172.21.15.159:0/3380451055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab00cd4f0 0x7faab0186220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7faaa8009e60 tx=0x7faaa8009780).ready entity=mon.0 client_cookie=bf912e9f2ad5ea4c server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:23.973 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaad59a700 1 -- 172.21.15.159:0/3380451055 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800e070 con 0x7faab00cd4f0 2022-09-17T10:27:23.973 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaad59a700 1 -- 172.21.15.159:0/3380451055 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa800bb60 con 0x7faab00cd4f0 2022-09-17T10:27:23.974 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.955+0000 7faaad59a700 1 -- 172.21.15.159:0/3380451055 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800bee0 con 0x7faab00cd4f0 2022-09-17T10:27:23.974 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.956+0000 7faab486c700 1 -- 172.21.15.159:0/3380451055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab00cd4f0 msgr2=0x7faab0186220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.974 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.956+0000 7faab486c700 1 --2- 172.21.15.159:0/3380451055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab00cd4f0 0x7faab0186220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7faaa8009e60 tx=0x7faaa8009780).stop 2022-09-17T10:27:23.975 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.956+0000 7faab486c700 1 -- 172.21.15.159:0/3380451055 shutdown_connections 2022-09-17T10:27:23.976 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.956+0000 7faab486c700 1 --2- 172.21.15.159:0/3380451055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab00cd4f0 0x7faab0186220 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.976 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.956+0000 7faab486c700 1 -- 172.21.15.159:0/3380451055 >> 172.21.15.159:0/3380451055 conn(0x7faab006a170 msgr2=0x7faab00f4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:23.977 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.956+0000 7faab486c700 1 -- 172.21.15.159:0/3380451055 shutdown_connections 2022-09-17T10:27:23.978 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.956+0000 7faab486c700 1 -- 172.21.15.159:0/3380451055 wait complete. 2022-09-17T10:27:23.978 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.957+0000 7faab486c700 1 Processor -- start 2022-09-17T10:27:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.958+0000 7faab486c700 1 -- start start 2022-09-17T10:27:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.958+0000 7faab486c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faab00cd4f0 0x7faab0154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.979 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.958+0000 7faab486c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faab00f0d50 0x7faab017def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.980 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faab486c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab0178940 0x7faab017fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:23.980 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faab486c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab017da60 con 0x7faab0178940 2022-09-17T10:27:23.981 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faab486c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab0180d50 con 0x7faab00f0d50 2022-09-17T10:27:23.981 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faab486c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab0180a70 con 0x7faab00cd4f0 2022-09-17T10:27:23.982 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faab00cd4f0 0x7faab0154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.982 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faab00cd4f0 0x7faab0154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37804/0 (socket says 172.21.15.159:37804) 2022-09-17T10:27:23.982 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 -- 172.21.15.159:0/1096400192 learned_addr learned my addr 172.21.15.159:0/1096400192 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:23.983 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaaed9d700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab0178940 0x7faab017fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.983 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaadd9b700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faab00f0d50 0x7faab017def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:23.984 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 -- 172.21.15.159:0/1096400192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faab00f0d50 msgr2=0x7faab017def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.984 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faab00f0d50 0x7faab017def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.984 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 -- 172.21.15.159:0/1096400192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab0178940 msgr2=0x7faab017fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:23.985 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab0178940 0x7faab017fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:23.985 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 -- 172.21.15.159:0/1096400192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa8009a20 con 0x7faab00cd4f0 2022-09-17T10:27:23.986 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaaed9d700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab0178940 0x7faab017fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:27:23.986 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faaae59c700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faab00cd4f0 0x7faab0154ae0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7faaa4001eb0 tx=0x7faaa4007c70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:23.987 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faa9e7fc700 1 -- 172.21.15.159:0/1096400192 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa400ce60 con 0x7faab00cd4f0 2022-09-17T10:27:23.987 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faa9e7fc700 1 -- 172.21.15.159:0/1096400192 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa400f470 con 0x7faab00cd4f0 2022-09-17T10:27:23.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab017d130 con 0x7faab00cd4f0 2022-09-17T10:27:23.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faa9e7fc700 1 -- 172.21.15.159:0/1096400192 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa400f810 con 0x7faab00cd4f0 2022-09-17T10:27:23.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.959+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab017d6f0 con 0x7faab00cd4f0 2022-09-17T10:27:23.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.960+0000 7faa9e7fc700 1 -- 172.21.15.159:0/1096400192 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7faaa4019030 con 0x7faab00cd4f0 2022-09-17T10:27:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.960+0000 7faa9e7fc700 1 -- 172.21.15.159:0/1096400192 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7faaa40128c0 con 0x7faab00cd4f0 2022-09-17T10:27:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.960+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab017dd40 con 0x7faab00cd4f0 2022-09-17T10:27:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:23.962+0000 7faa9e7fc700 1 -- 172.21.15.159:0/1096400192 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7faaa4017070 con 0x7faab00cd4f0 2022-09-17T10:27:23.990 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:23.986+0000 7f63a4644680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-17T10:27:24.006 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:24.003+0000 7f3248a31680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-17T10:27:24.045 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.042+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9278d65c-b17e-4045-adfc-d2e96019b1f0", "id": 3} v 0) v1 -- 0x7faab006bf40 con 0x7faab00cd4f0 2022-09-17T10:27:24.053 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.050+0000 7faa9e7fc700 1 -- 172.21.15.159:0/1096400192 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9278d65c-b17e-4045-adfc-d2e96019b1f0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7faaa4012b90 con 0x7faab00cd4f0 2022-09-17T10:27:24.054 INFO:teuthology.orchestra.run.smithi159.stdout:3 2022-09-17T10:27:24.055 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faab00cd4f0 msgr2=0x7faab0154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.056 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faab00cd4f0 0x7faab0154ae0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7faaa4001eb0 tx=0x7faaa4007c70).stop 2022-09-17T10:27:24.056 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 shutdown_connections 2022-09-17T10:27:24.056 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faab0178940 0x7faab017fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.056 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faab00cd4f0 0x7faab0154ae0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.057 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 --2- 172.21.15.159:0/1096400192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faab00f0d50 0x7faab017def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.057 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 >> 172.21.15.159:0/1096400192 conn(0x7faab006a170 msgr2=0x7faab0177960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.057 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 shutdown_connections 2022-09-17T10:27:24.057 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.051+0000 7faab486c700 1 -- 172.21.15.159:0/1096400192 wait complete. 2022-09-17T10:27:24.067 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new fbed8313-d12f-4e79-8f22-d387097835b7 4 2022-09-17T10:27:24.224 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.221+0000 7f31f12e1700 1 Processor -- start 2022-09-17T10:27:24.224 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.221+0000 7f31f12e1700 1 -- start start 2022-09-17T10:27:24.227 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31f12e1700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f31ec178940 0x7f31ec0cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.227 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31f12e1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec0cd060 con 0x7f31ec0f0d50 2022-09-17T10:27:24.227 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31f12e1700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec0cc170 con 0x7f31ec0cb710 2022-09-17T10:27:24.227 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31f12e1700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec17cc40 con 0x7f31ec178940 2022-09-17T10:27:24.228 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31eaffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f31ec178940 0x7f31ec0cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.228 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31eaffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f31ec178940 0x7f31ec0cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37820/0 (socket says 172.21.15.159:37820) 2022-09-17T10:27:24.228 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31eaffd700 1 -- 172.21.15.159:0/2770037907 learned_addr learned my addr 172.21.15.159:0/2770037907 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:24.228 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31eaffd700 1 -- 172.21.15.159:0/2770037907 >> v1:172.21.15.93:6789/0 conn(0x7f31ec0cb710 legacy=0x7f31ec185210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.229 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31eaffd700 1 -- 172.21.15.159:0/2770037907 >> v1:172.21.15.62:6789/0 conn(0x7f31ec0f0d50 legacy=0x7f31ec17c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.229 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31eaffd700 1 -- 172.21.15.159:0/2770037907 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec0cc450 con 0x7f31ec178940 2022-09-17T10:27:24.229 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.222+0000 7f31eaffd700 1 --2- 172.21.15.159:0/2770037907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec0cd4f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f31e0006fd0 tx=0x7f31e00090f0).ready entity=mon.2 client_cookie=cd7da14d2fde6a87 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:24.229 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31e9ffb700 1 -- 172.21.15.159:0/2770037907 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e000b600 con 0x7f31ec178940 2022-09-17T10:27:24.230 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31e9ffb700 1 -- 172.21.15.159:0/2770037907 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e000b760 con 0x7f31ec178940 2022-09-17T10:27:24.230 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31e9ffb700 1 -- 172.21.15.159:0/2770037907 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e000bae0 con 0x7f31ec178940 2022-09-17T10:27:24.230 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31f12e1700 1 -- 172.21.15.159:0/2770037907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 msgr2=0x7f31ec0cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.231 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31f12e1700 1 --2- 172.21.15.159:0/2770037907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec0cd4f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f31e0006fd0 tx=0x7f31e00090f0).stop 2022-09-17T10:27:24.231 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31f12e1700 1 -- 172.21.15.159:0/2770037907 shutdown_connections 2022-09-17T10:27:24.231 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31f12e1700 1 --2- 172.21.15.159:0/2770037907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec0cd4f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.231 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31f12e1700 1 -- 172.21.15.159:0/2770037907 >> 172.21.15.159:0/2770037907 conn(0x7f31ec06a170 msgr2=0x7f31ec0f4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.232 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31f12e1700 1 -- 172.21.15.159:0/2770037907 shutdown_connections 2022-09-17T10:27:24.232 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.223+0000 7f31f12e1700 1 -- 172.21.15.159:0/2770037907 wait complete. 2022-09-17T10:27:24.235 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.225+0000 7f31f12e1700 1 Processor -- start 2022-09-17T10:27:24.235 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.225+0000 7f31f12e1700 1 -- start start 2022-09-17T10:27:24.236 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31f12e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec0cb710 0x7f31ec18fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.236 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31f12e1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31ec0f0d50 0x7f31ec18f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.236 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31f12e1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec175f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.236 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31f12e1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec190750 con 0x7f31ec0cb710 2022-09-17T10:27:24.237 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31f12e1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec190a30 con 0x7f31ec0f0d50 2022-09-17T10:27:24.237 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31f12e1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec190d10 con 0x7f31ec178940 2022-09-17T10:27:24.237 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eb7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec175f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.237 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eb7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec175f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37834/0 (socket says 172.21.15.159:37834) 2022-09-17T10:27:24.237 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eb7fe700 1 -- 172.21.15.159:0/1376699399 learned_addr learned my addr 172.21.15.159:0/1376699399 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:24.238 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31ea7fc700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31ec0f0d50 0x7f31ec18f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.238 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eaffd700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec0cb710 0x7f31ec18fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.238 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eb7fe700 1 -- 172.21.15.159:0/1376699399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31ec0f0d50 msgr2=0x7f31ec18f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.238 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eb7fe700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31ec0f0d50 0x7f31ec18f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.239 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eb7fe700 1 -- 172.21.15.159:0/1376699399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec0cb710 msgr2=0x7f31ec18fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.239 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eb7fe700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec0cb710 0x7f31ec18fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.239 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.226+0000 7f31eb7fe700 1 -- 172.21.15.159:0/1376699399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0009370 con 0x7f31ec178940 2022-09-17T10:27:24.239 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.227+0000 7f31eb7fe700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec175f60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f31e400c7c0 tx=0x7f31e4001510).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:24.240 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.227+0000 7f31d2ffd700 1 -- 172.21.15.159:0/1376699399 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400e4a0 con 0x7f31ec178940 2022-09-17T10:27:24.240 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.227+0000 7f31d2ffd700 1 -- 172.21.15.159:0/1376699399 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e400e600 con 0x7f31ec178940 2022-09-17T10:27:24.240 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.227+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec190ff0 con 0x7f31ec178940 2022-09-17T10:27:24.241 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.227+0000 7f31d2ffd700 1 -- 172.21.15.159:0/1376699399 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400e980 con 0x7f31ec178940 2022-09-17T10:27:24.241 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.227+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec1915b0 con 0x7f31ec178940 2022-09-17T10:27:24.241 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.227+0000 7f31d2ffd700 1 -- 172.21.15.159:0/1376699399 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f31e4010070 con 0x7f31ec178940 2022-09-17T10:27:24.241 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.227+0000 7f31d2ffd700 1 -- 172.21.15.159:0/1376699399 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f31e401bc90 con 0x7f31ec178940 2022-09-17T10:27:24.242 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.228+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec0ef650 con 0x7f31ec178940 2022-09-17T10:27:24.242 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.230+0000 7f31d2ffd700 1 -- 172.21.15.159:0/1376699399 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f31e4020060 con 0x7f31ec178940 2022-09-17T10:27:24.312 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.309+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fbed8313-d12f-4e79-8f22-d387097835b7", "id": 4} v 0) v1 -- 0x7f31ec1917d0 con 0x7f31ec178940 2022-09-17T10:27:24.320 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.317+0000 7f31d2ffd700 1 -- 172.21.15.159:0/1376699399 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbed8313-d12f-4e79-8f22-d387097835b7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f31e400edc0 con 0x7f31ec178940 2022-09-17T10:27:24.321 INFO:teuthology.orchestra.run.smithi159.stdout:4 2022-09-17T10:27:24.323 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 msgr2=0x7f31ec175f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.324 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec175f60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f31e400c7c0 tx=0x7f31e4001510).stop 2022-09-17T10:27:24.324 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 shutdown_connections 2022-09-17T10:27:24.325 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ec178940 0x7f31ec175f60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.325 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec0cb710 0x7f31ec18fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.326 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 --2- 172.21.15.159:0/1376699399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31ec0f0d50 0x7f31ec18f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.326 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 >> 172.21.15.159:0/1376699399 conn(0x7f31ec06a170 msgr2=0x7f31ec06b320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.326 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 shutdown_connections 2022-09-17T10:27:24.327 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.318+0000 7f31f12e1700 1 -- 172.21.15.159:0/1376699399 wait complete. 2022-09-17T10:27:24.333 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new b9e1942a-3fde-4686-9d3d-0d6eb7bffe90 5 2022-09-17T10:27:24.347 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:24.345+0000 7f414c034680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-17T10:27:24.453 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:24.445+0000 7f414c034680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-17T10:27:24.454 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:24.441+0000 7f63a4644680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-17T10:27:24.462 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:24.457+0000 7f3248a31680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-17T10:27:24.463 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.443+0000 7ff564e51700 1 Processor -- start 2022-09-17T10:27:24.464 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.444+0000 7ff564e51700 1 -- start start 2022-09-17T10:27:24.464 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff564e51700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5601754e0 0x7ff56017cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.465 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff564e51700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56017c700 con 0x7ff560175100 2022-09-17T10:27:24.465 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff564e51700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff560083cd0 con 0x7ff56017d080 2022-09-17T10:27:24.466 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff564e51700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff560083f90 con 0x7ff5601754e0 2022-09-17T10:27:24.466 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55ed9d700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7ff56017d080 0x7ff56017b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:59070/0 (socket says 172.21.15.159:59070) 2022-09-17T10:27:24.466 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55ed9d700 1 -- 172.21.15.159:0/327497010 learned_addr learned my addr 172.21.15.159:0/327497010 (peer_addr_for_me v1:172.21.15.159:0/0) 2022-09-17T10:27:24.466 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55dd9b700 1 --2- 172.21.15.159:0/327497010 >> v2:172.21.15.62:3300/0 conn(0x7ff5601754e0 0x7ff56017cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.467 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55d59a700 1 -- 172.21.15.159:0/327497010 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138737247 0 0) 0x7ff560083cd0 con 0x7ff56017d080 2022-09-17T10:27:24.467 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55d59a700 1 -- 172.21.15.159:0/327497010 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5400033f0 con 0x7ff56017d080 2022-09-17T10:27:24.467 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55d59a700 1 -- 172.21.15.159:0/327497010 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955663617 0 0) 0x7ff56017c700 con 0x7ff560175100 2022-09-17T10:27:24.467 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55d59a700 1 -- 172.21.15.159:0/327497010 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff560083cd0 con 0x7ff560175100 2022-09-17T10:27:24.468 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55d59a700 1 -- 172.21.15.159:0/327497010 <== mon.2 v1:172.21.15.159:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 601810957 0 0) 0x7ff5400033f0 con 0x7ff56017d080 2022-09-17T10:27:24.468 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55dd9b700 1 -- 172.21.15.159:0/327497010 >> v1:172.21.15.159:6789/0 conn(0x7ff56017d080 legacy=0x7ff56017b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.468 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55dd9b700 1 -- 172.21.15.159:0/327497010 >> v1:172.21.15.62:6789/0 conn(0x7ff560175100 legacy=0x7ff5600835c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.468 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.445+0000 7ff55dd9b700 1 -- 172.21.15.159:0/327497010 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560084270 con 0x7ff5601754e0 2022-09-17T10:27:24.468 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff55dd9b700 1 --2- 172.21.15.159:0/327497010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 0x7ff56017cb90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff5480096e0 tx=0x7ff548009060).ready entity=mon.0 client_cookie=e12bd4fe84ad862c server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:24.469 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff55d59a700 1 -- 172.21.15.159:0/327497010 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580017f0 con 0x7ff5601754e0 2022-09-17T10:27:24.469 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff55d59a700 1 -- 172.21.15.159:0/327497010 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548011400 con 0x7ff5601754e0 2022-09-17T10:27:24.469 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff55d59a700 1 -- 172.21.15.159:0/327497010 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548011780 con 0x7ff5601754e0 2022-09-17T10:27:24.469 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff564e51700 1 -- 172.21.15.159:0/327497010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 msgr2=0x7ff56017cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff564e51700 1 --2- 172.21.15.159:0/327497010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 0x7ff56017cb90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff5480096e0 tx=0x7ff548009060).stop 2022-09-17T10:27:24.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff564e51700 1 -- 172.21.15.159:0/327497010 shutdown_connections 2022-09-17T10:27:24.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff564e51700 1 --2- 172.21.15.159:0/327497010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 0x7ff56017cb90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff564e51700 1 -- 172.21.15.159:0/327497010 >> 172.21.15.159:0/327497010 conn(0x7ff5600eeea0 msgr2=0x7ff56005d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff564e51700 1 -- 172.21.15.159:0/327497010 shutdown_connections 2022-09-17T10:27:24.471 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.446+0000 7ff564e51700 1 -- 172.21.15.159:0/327497010 wait complete. 2022-09-17T10:27:24.471 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.448+0000 7ff564e51700 1 Processor -- start 2022-09-17T10:27:24.471 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.448+0000 7ff564e51700 1 -- start start 2022-09-17T10:27:24.471 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff564e51700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff560175100 0x7ff5600f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.472 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff564e51700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 0x7ff56016ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.472 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff564e51700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff56017d080 0x7ff56018c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.472 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff564e51700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56018b6d0 con 0x7ff5601754e0 2022-09-17T10:27:24.472 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff564e51700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56018bf70 con 0x7ff560175100 2022-09-17T10:27:24.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff564e51700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600f1770 con 0x7ff56017d080 2022-09-17T10:27:24.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff56017d080 0x7ff56018c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff56017d080 0x7ff56018c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46870/0 (socket says 172.21.15.159:46870) 2022-09-17T10:27:24.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 -- 172.21.15.159:0/387589682 learned_addr learned my addr 172.21.15.159:0/387589682 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:24.474 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55dd9b700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 0x7ff56016ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.474 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55e59c700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff560175100 0x7ff5600f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.474 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 -- 172.21.15.159:0/387589682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff560175100 msgr2=0x7ff5600f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.474 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff560175100 0x7ff5600f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 -- 172.21.15.159:0/387589682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 msgr2=0x7ff56016ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 0x7ff56016ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 -- 172.21.15.159:0/387589682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480092a0 con 0x7ff56017d080 2022-09-17T10:27:24.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff55ed9d700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff56017d080 0x7ff56018c400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff55800cb70 tx=0x7ff5580018e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:24.476 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.449+0000 7ff5567fc700 1 -- 172.21.15.159:0/387589682 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558004c40 con 0x7ff56017d080 2022-09-17T10:27:24.476 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.450+0000 7ff5567fc700 1 -- 172.21.15.159:0/387589682 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558004de0 con 0x7ff56017d080 2022-09-17T10:27:24.476 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.450+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff560063630 con 0x7ff56017d080 2022-09-17T10:27:24.476 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.450+0000 7ff5567fc700 1 -- 172.21.15.159:0/387589682 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580073c0 con 0x7ff56017d080 2022-09-17T10:27:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.450+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56018b920 con 0x7ff56017d080 2022-09-17T10:27:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.450+0000 7ff5567fc700 1 -- 172.21.15.159:0/387589682 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7ff55801b060 con 0x7ff56017d080 2022-09-17T10:27:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.450+0000 7ff5567fc700 1 -- 172.21.15.159:0/387589682 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7ff558014460 con 0x7ff56017d080 2022-09-17T10:27:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.450+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56018c0e0 con 0x7ff56017d080 2022-09-17T10:27:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.453+0000 7ff5567fc700 1 -- 172.21.15.159:0/387589682 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7ff558019070 con 0x7ff56017d080 2022-09-17T10:27:24.534 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.531+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b9e1942a-3fde-4686-9d3d-0d6eb7bffe90", "id": 5} v 0) v1 -- 0x7ff560084550 con 0x7ff56017d080 2022-09-17T10:27:24.542 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.539+0000 7ff5567fc700 1 -- 172.21.15.159:0/387589682 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9e1942a-3fde-4686-9d3d-0d6eb7bffe90", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff558007bc0 con 0x7ff56017d080 2022-09-17T10:27:24.543 INFO:teuthology.orchestra.run.smithi159.stdout:5 2022-09-17T10:27:24.545 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff56017d080 msgr2=0x7ff56018c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.545 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff56017d080 0x7ff56018c400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff55800cb70 tx=0x7ff5580018e0).stop 2022-09-17T10:27:24.546 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 shutdown_connections 2022-09-17T10:27:24.546 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff560175100 0x7ff5600f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.547 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff56017d080 0x7ff56018c400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.547 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 --2- 172.21.15.159:0/387589682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5601754e0 0x7ff56016ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.548 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 >> 172.21.15.159:0/387589682 conn(0x7ff5600eeea0 msgr2=0x7ff5601710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.548 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 shutdown_connections 2022-09-17T10:27:24.548 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.540+0000 7ff564e51700 1 -- 172.21.15.159:0/387589682 wait complete. 2022-09-17T10:27:24.550 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:24.547+0000 7f63a4644680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-17T10:27:24.554 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 44fdf3ae-54fc-4276-978d-cd8cdbf551f2 6 2022-09-17T10:27:24.567 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:24.564+0000 7f3248a31680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-17T10:27:24.598 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:24.596+0000 7f414c034680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-17T10:27:24.671 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.668+0000 7f1dc83a1700 1 Processor -- start 2022-09-17T10:27:24.672 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.668+0000 7f1dc83a1700 1 -- start start 2022-09-17T10:27:24.673 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:24.670+0000 7f414c034680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-17T10:27:24.685 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.669+0000 7f1dc83a1700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1dc00683d0 0x7f1dc0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.685 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.669+0000 7f1dc83a1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc006a2a0 con 0x7f1dc017e3c0 2022-09-17T10:27:24.686 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.669+0000 7f1dc83a1700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc0068a30 con 0x7f1dc017dfe0 2022-09-17T10:27:24.686 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.669+0000 7f1dc83a1700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc0068d10 con 0x7f1dc00683d0 2022-09-17T10:27:24.686 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.669+0000 7f1dc693e700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1dc00683d0 0x7f1dc0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.686 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.669+0000 7f1dc693e700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1dc00683d0 0x7f1dc0069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46886/0 (socket says 172.21.15.159:46886) 2022-09-17T10:27:24.687 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.669+0000 7f1dc693e700 1 -- 172.21.15.159:0/182223102 learned_addr learned my addr 172.21.15.159:0/182223102 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:24.687 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc693e700 1 -- 172.21.15.159:0/182223102 >> v1:172.21.15.93:6789/0 conn(0x7f1dc017dfe0 legacy=0x7f1dc0084010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.687 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc693e700 1 -- 172.21.15.159:0/182223102 >> v1:172.21.15.62:6789/0 conn(0x7f1dc017e3c0 legacy=0x7f1dc0183130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.687 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc693e700 1 -- 172.21.15.159:0/182223102 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0068ff0 con 0x7f1dc00683d0 2022-09-17T10:27:24.688 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc693e700 1 --2- 172.21.15.159:0/182223102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc00683d0 0x7f1dc0069db0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1db8009f50 tx=0x7f1db8009840).ready entity=mon.2 client_cookie=404da631527e65b8 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:24.688 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc513b700 1 -- 172.21.15.159:0/182223102 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db800e070 con 0x7f1dc00683d0 2022-09-17T10:27:24.688 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc513b700 1 -- 172.21.15.159:0/182223102 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db800ba70 con 0x7f1dc00683d0 2022-09-17T10:27:24.688 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc513b700 1 -- 172.21.15.159:0/182223102 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db800bdf0 con 0x7f1dc00683d0 2022-09-17T10:27:24.689 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc83a1700 1 -- 172.21.15.159:0/182223102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc00683d0 msgr2=0x7f1dc0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.689 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.670+0000 7f1dc83a1700 1 --2- 172.21.15.159:0/182223102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc00683d0 0x7f1dc0069db0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1db8009f50 tx=0x7f1db8009840).stop 2022-09-17T10:27:24.689 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.671+0000 7f1dc83a1700 1 -- 172.21.15.159:0/182223102 shutdown_connections 2022-09-17T10:27:24.689 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.671+0000 7f1dc83a1700 1 --2- 172.21.15.159:0/182223102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc00683d0 0x7f1dc0069db0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.689 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.671+0000 7f1dc83a1700 1 -- 172.21.15.159:0/182223102 >> 172.21.15.159:0/182223102 conn(0x7f1dc0062a40 msgr2=0x7f1dc00f2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.690 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.671+0000 7f1dc83a1700 1 -- 172.21.15.159:0/182223102 shutdown_connections 2022-09-17T10:27:24.690 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.671+0000 7f1dc83a1700 1 -- 172.21.15.159:0/182223102 wait complete. 2022-09-17T10:27:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.672+0000 7f1dc83a1700 1 Processor -- start 2022-09-17T10:27:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.672+0000 7f1dc83a1700 1 -- start start 2022-09-17T10:27:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc83a1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dc00683d0 0x7f1dc016eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc83a1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc017dfe0 0x7f1dc00ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc83a1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1dc017e3c0 0x7f1dc00efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc83a1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc0192050 con 0x7f1dc00683d0 2022-09-17T10:27:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc83a1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc017bb90 con 0x7f1dc017e3c0 2022-09-17T10:27:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc83a1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc01917b0 con 0x7f1dc017dfe0 2022-09-17T10:27:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc593c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc017dfe0 0x7f1dc00ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.699 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc593c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc017dfe0 0x7f1dc00ef9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46896/0 (socket says 172.21.15.159:46896) 2022-09-17T10:27:24.699 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc593c700 1 -- 172.21.15.159:0/2548800595 learned_addr learned my addr 172.21.15.159:0/2548800595 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:24.699 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc693e700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1dc017e3c0 0x7f1dc00efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.699 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc613d700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dc00683d0 0x7f1dc016eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.700 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc593c700 1 -- 172.21.15.159:0/2548800595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1dc017e3c0 msgr2=0x7f1dc00efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.700 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc593c700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1dc017e3c0 0x7f1dc00efea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.700 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc593c700 1 -- 172.21.15.159:0/2548800595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dc00683d0 msgr2=0x7f1dc016eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.700 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc593c700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dc00683d0 0x7f1dc016eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.700 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.673+0000 7f1dc593c700 1 -- 172.21.15.159:0/2548800595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8009ae0 con 0x7f1dc017dfe0 2022-09-17T10:27:24.701 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.674+0000 7f1dc593c700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc017dfe0 0x7f1dc00ef9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1db000c470 tx=0x7f1db0007e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:24.701 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.674+0000 7f1dae7fc700 1 -- 172.21.15.159:0/2548800595 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0007020 con 0x7f1dc017dfe0 2022-09-17T10:27:24.701 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.674+0000 7f1dae7fc700 1 -- 172.21.15.159:0/2548800595 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0007180 con 0x7f1dc017dfe0 2022-09-17T10:27:24.701 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.674+0000 7f1dae7fc700 1 -- 172.21.15.159:0/2548800595 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0007540 con 0x7f1dc017dfe0 2022-09-17T10:27:24.702 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.674+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc0191a90 con 0x7f1dc017dfe0 2022-09-17T10:27:24.702 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.674+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc017b820 con 0x7f1dc017dfe0 2022-09-17T10:27:24.702 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.674+0000 7f1dae7fc700 1 -- 172.21.15.159:0/2548800595 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f1db0010070 con 0x7f1dc017dfe0 2022-09-17T10:27:24.702 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.674+0000 7f1dae7fc700 1 -- 172.21.15.159:0/2548800595 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f1db0012a20 con 0x7f1dc017dfe0 2022-09-17T10:27:24.703 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.675+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc0174a00 con 0x7f1dc017dfe0 2022-09-17T10:27:24.703 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.677+0000 7f1dae7fc700 1 -- 172.21.15.159:0/2548800595 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f1db0012d80 con 0x7f1dc017dfe0 2022-09-17T10:27:24.712 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:24.709+0000 7f63a4644680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-17T10:27:24.726 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:24.723+0000 7f3248a31680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-17T10:27:24.741 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:24.739+0000 7f414c034680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-17T10:27:24.760 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.757+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44fdf3ae-54fc-4276-978d-cd8cdbf551f2", "id": 6} v 0) v1 -- 0x7f1dc006bf40 con 0x7f1dc017dfe0 2022-09-17T10:27:24.767 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.764+0000 7f1dae7fc700 1 -- 172.21.15.159:0/2548800595 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44fdf3ae-54fc-4276-978d-cd8cdbf551f2", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1db0012400 con 0x7f1dc017dfe0 2022-09-17T10:27:24.768 INFO:teuthology.orchestra.run.smithi159.stdout:6 2022-09-17T10:27:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc017dfe0 msgr2=0x7f1dc00ef9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.770 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc017dfe0 0x7f1dc00ef9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1db000c470 tx=0x7f1db0007e20).stop 2022-09-17T10:27:24.770 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 shutdown_connections 2022-09-17T10:27:24.770 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1dc017e3c0 0x7f1dc00efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.770 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dc00683d0 0x7f1dc016eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.771 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 --2- 172.21.15.159:0/2548800595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc017dfe0 0x7f1dc00ef9b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.771 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 >> 172.21.15.159:0/2548800595 conn(0x7f1dc0062a40 msgr2=0x7f1dc0165d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.771 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 shutdown_connections 2022-09-17T10:27:24.772 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.766+0000 7f1dc83a1700 1 -- 172.21.15.159:0/2548800595 wait complete. 2022-09-17T10:27:24.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new a33d0b4b-7855-4df5-a940-ef1ed14dc089 7 2022-09-17T10:27:24.798 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:24.794+0000 7f63a4644680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-17T10:27:24.806 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:24.803+0000 7f3248a31680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-17T10:27:24.870 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:24.867+0000 7f63a4644680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-17T10:27:24.878 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:24.875+0000 7f3248a31680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-17T10:27:24.909 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.896+0000 7f31096ec700 1 Processor -- start 2022-09-17T10:27:24.909 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.896+0000 7f31096ec700 1 -- start start 2022-09-17T10:27:24.909 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.897+0000 7f31096ec700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3104178940 0x7f31040cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.910 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.897+0000 7f31096ec700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31040cd060 con 0x7f31040f0d50 2022-09-17T10:27:24.910 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.897+0000 7f31096ec700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31040cc170 con 0x7f31040cb710 2022-09-17T10:27:24.910 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.897+0000 7f31096ec700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310417cc40 con 0x7f3104178940 2022-09-17T10:27:24.911 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f31027fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f31040f0d50 0x7f310417c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.159:35824/0 (socket says 172.21.15.159:35824) 2022-09-17T10:27:24.911 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f31027fc700 1 -- 172.21.15.159:0/1783350083 learned_addr learned my addr 172.21.15.159:0/1783350083 (peer_addr_for_me v1:172.21.15.159:0/0) 2022-09-17T10:27:24.911 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3102ffd700 1 --2- 172.21.15.159:0/1783350083 >> v2:172.21.15.93:3300/0 conn(0x7f3104178940 0x7f31040cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.912 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3101ffb700 1 -- 172.21.15.159:0/1783350083 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877385634 0 0) 0x7f31040cd060 con 0x7f31040f0d50 2022-09-17T10:27:24.912 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3101ffb700 1 -- 172.21.15.159:0/1783350083 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30f00033f0 con 0x7f31040f0d50 2022-09-17T10:27:24.913 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3102ffd700 1 -- 172.21.15.159:0/1783350083 >> v1:172.21.15.93:6789/0 conn(0x7f31040cb710 legacy=0x7f3104185210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.913 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3101ffb700 1 -- 172.21.15.159:0/1783350083 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039479990 0 0) 0x7f31040cc170 con 0x7f31040cb710 2022-09-17T10:27:24.913 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3102ffd700 1 -- 172.21.15.159:0/1783350083 >> v1:172.21.15.62:6789/0 conn(0x7f31040f0d50 legacy=0x7f310417c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.914 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3102ffd700 1 -- 172.21.15.159:0/1783350083 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040cc450 con 0x7f3104178940 2022-09-17T10:27:24.914 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3102ffd700 1 --2- 172.21.15.159:0/1783350083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3104178940 0x7f31040cd4f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f30f8009760 tx=0x7f30f8009060).ready entity=mon.1 client_cookie=912f7faf461417b3 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:24.914 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3101ffb700 1 -- 172.21.15.159:0/1783350083 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f800f510 con 0x7f3104178940 2022-09-17T10:27:24.914 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3101ffb700 1 -- 172.21.15.159:0/1783350083 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f800f670 con 0x7f3104178940 2022-09-17T10:27:24.915 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.898+0000 7f3101ffb700 1 -- 172.21.15.159:0/1783350083 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f800f9f0 con 0x7f3104178940 2022-09-17T10:27:24.915 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.899+0000 7f31096ec700 1 -- 172.21.15.159:0/1783350083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3104178940 msgr2=0x7f31040cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.915 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.899+0000 7f31096ec700 1 --2- 172.21.15.159:0/1783350083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3104178940 0x7f31040cd4f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f30f8009760 tx=0x7f30f8009060).stop 2022-09-17T10:27:24.916 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.899+0000 7f31096ec700 1 -- 172.21.15.159:0/1783350083 shutdown_connections 2022-09-17T10:27:24.916 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.899+0000 7f31096ec700 1 --2- 172.21.15.159:0/1783350083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3104178940 0x7f31040cd4f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.917 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.899+0000 7f31096ec700 1 -- 172.21.15.159:0/1783350083 >> 172.21.15.159:0/1783350083 conn(0x7f310406a170 msgr2=0x7f31040f4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.917 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.899+0000 7f31096ec700 1 -- 172.21.15.159:0/1783350083 shutdown_connections 2022-09-17T10:27:24.918 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.899+0000 7f31096ec700 1 -- 172.21.15.159:0/1783350083 wait complete. 2022-09-17T10:27:24.918 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.900+0000 7f31096ec700 1 Processor -- start 2022-09-17T10:27:24.919 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.900+0000 7f31096ec700 1 -- start start 2022-09-17T10:27:24.919 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.901+0000 7f31096ec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040cb710 0x7f31040eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.920 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.901+0000 7f31096ec700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040f0d50 0x7f3104154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.920 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.901+0000 7f31096ec700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3104178940 0x7f310417d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:24.921 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.901+0000 7f31096ec700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3104154920 con 0x7f31040cb710 2022-09-17T10:27:24.921 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.901+0000 7f31096ec700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31041552a0 con 0x7f31040f0d50 2022-09-17T10:27:24.922 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.901+0000 7f31096ec700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3104154320 con 0x7f3104178940 2022-09-17T10:27:24.923 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3104178940 0x7f310417d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.923 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31027fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040f0d50 0x7f3104154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3104178940 0x7f310417d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46910/0 (socket says 172.21.15.159:46910) 2022-09-17T10:27:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 -- 172.21.15.159:0/1064509861 learned_addr learned my addr 172.21.15.159:0/1064509861 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:24.925 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f3102ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040cb710 0x7f31040eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:24.925 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 -- 172.21.15.159:0/1064509861 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040f0d50 msgr2=0x7f3104154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.925 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 --2- 172.21.15.159:0/1064509861 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040f0d50 0x7f3104154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.925 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 -- 172.21.15.159:0/1064509861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040cb710 msgr2=0x7f31040eb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.926 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 --2- 172.21.15.159:0/1064509861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040cb710 0x7f31040eb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.926 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 -- 172.21.15.159:0/1064509861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80092a0 con 0x7f3104178940 2022-09-17T10:27:24.927 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f3102ffd700 1 --2- 172.21.15.159:0/1064509861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040cb710 0x7f31040eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:27:24.927 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31037fe700 1 --2- 172.21.15.159:0/1064509861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3104178940 0x7f310417d6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f30fc00c840 tx=0x7f30fc0014a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:24.929 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f30eaffd700 1 -- 172.21.15.159:0/1064509861 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc00e4a0 con 0x7f3104178940 2022-09-17T10:27:24.929 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f30eaffd700 1 -- 172.21.15.159:0/1064509861 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc00e620 con 0x7f3104178940 2022-09-17T10:27:24.929 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310417de90 con 0x7f3104178940 2022-09-17T10:27:24.930 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f30eaffd700 1 -- 172.21.15.159:0/1064509861 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc00e9e0 con 0x7f3104178940 2022-09-17T10:27:24.930 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310417e450 con 0x7f3104178940 2022-09-17T10:27:24.930 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f30eaffd700 1 -- 172.21.15.159:0/1064509861 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f30fc010070 con 0x7f3104178940 2022-09-17T10:27:24.930 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.902+0000 7f30eaffd700 1 -- 172.21.15.159:0/1064509861 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f30fc012a80 con 0x7f3104178940 2022-09-17T10:27:24.931 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.903+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310406bf40 con 0x7f3104178940 2022-09-17T10:27:24.932 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.905+0000 7f30eaffd700 1 -- 172.21.15.159:0/1064509861 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f30fc01b3f0 con 0x7f3104178940 2022-09-17T10:27:24.988 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.985+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a33d0b4b-7855-4df5-a940-ef1ed14dc089", "id": 7} v 0) v1 -- 0x7f31040cc730 con 0x7f3104178940 2022-09-17T10:27:24.992 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.989+0000 7f30eaffd700 1 -- 172.21.15.159:0/1064509861 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a33d0b4b-7855-4df5-a940-ef1ed14dc089", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f30fc01b590 con 0x7f3104178940 2022-09-17T10:27:24.992 INFO:teuthology.orchestra.run.smithi159.stdout:7 2022-09-17T10:27:24.994 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3104178940 msgr2=0x7f310417d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:24.994 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 --2- 172.21.15.159:0/1064509861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3104178940 0x7f310417d6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f30fc00c840 tx=0x7f30fc0014a0).stop 2022-09-17T10:27:24.995 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 shutdown_connections 2022-09-17T10:27:24.995 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 --2- 172.21.15.159:0/1064509861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3104178940 0x7f310417d6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.995 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 --2- 172.21.15.159:0/1064509861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040cb710 0x7f31040eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.995 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 --2- 172.21.15.159:0/1064509861 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040f0d50 0x7f3104154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:24.996 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 >> 172.21.15.159:0/1064509861 conn(0x7f310406a170 msgr2=0x7f31040f2440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:24.996 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 shutdown_connections 2022-09-17T10:27:24.996 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:24.990+0000 7f31096ec700 1 -- 172.21.15.159:0/1064509861 wait complete. 2022-09-17T10:27:25.000 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:24.999+0000 7f414c034680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-17T10:27:25.004 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 1fb7510e-c67f-4523-8906-7fbe25054044 8 2022-09-17T10:27:25.144 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:25.141+0000 7f63a4644680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-17T10:27:25.155 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:25.152+0000 7f3248a31680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-17T10:27:25.158 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.155+0000 7fa94a386700 1 Processor -- start 2022-09-17T10:27:25.159 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.155+0000 7fa94a386700 1 -- start start 2022-09-17T10:27:25.162 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa94a386700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa9441751b0 0x7fa944180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.162 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa94a386700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa944175590 0x7fa944180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.162 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa94a386700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440c6dd0 con 0x7fa944181050 2022-09-17T10:27:25.162 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa94a386700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9440f10e0 con 0x7fa9441751b0 2022-09-17T10:27:25.163 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa94a386700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9440f0660 con 0x7fa944175590 2022-09-17T10:27:25.163 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa9437fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa944175590 0x7fa944180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.163 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa9437fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa944175590 0x7fa944180b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46926/0 (socket says 172.21.15.159:46926) 2022-09-17T10:27:25.163 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa9437fe700 1 -- 172.21.15.159:0/1903756865 learned_addr learned my addr 172.21.15.159:0/1903756865 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:25.164 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa943fff700 1 --2- 172.21.15.159:0/1903756865 >> v2:172.21.15.93:3300/0 conn(0x7fa9441751b0 0x7fa944180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.164 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa9437fe700 1 -- 172.21.15.159:0/1903756865 >> v2:172.21.15.93:3300/0 conn(0x7fa9441751b0 msgr2=0x7fa944180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:25.164 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa9437fe700 1 --2- 172.21.15.159:0/1903756865 >> v2:172.21.15.93:3300/0 conn(0x7fa9441751b0 0x7fa944180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.164 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa9437fe700 1 -- 172.21.15.159:0/1903756865 >> v1:172.21.15.93:6789/0 conn(0x7fa944181050 legacy=0x7fa944181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa9437fe700 1 -- 172.21.15.159:0/1903756865 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9441801e0 con 0x7fa944175590 2022-09-17T10:27:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa9437fe700 1 --2- 172.21.15.159:0/1903756865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa944175590 0x7fa944180b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa944085780 tx=0x7fa9340090f0).ready entity=mon.2 client_cookie=4b2f1818d4f315f2 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa942ffd700 1 -- 172.21.15.159:0/1903756865 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400b520 con 0x7fa944175590 2022-09-17T10:27:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa942ffd700 1 -- 172.21.15.159:0/1903756865 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93400b680 con 0x7fa944175590 2022-09-17T10:27:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.157+0000 7fa942ffd700 1 -- 172.21.15.159:0/1903756865 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400ba20 con 0x7fa944175590 2022-09-17T10:27:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.158+0000 7fa94a386700 1 -- 172.21.15.159:0/1903756865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa944175590 msgr2=0x7fa944180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.158+0000 7fa94a386700 1 --2- 172.21.15.159:0/1903756865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa944175590 0x7fa944180b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa944085780 tx=0x7fa9340090f0).stop 2022-09-17T10:27:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.158+0000 7fa94a386700 1 -- 172.21.15.159:0/1903756865 shutdown_connections 2022-09-17T10:27:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.158+0000 7fa94a386700 1 --2- 172.21.15.159:0/1903756865 >> v2:172.21.15.93:3300/0 conn(0x7fa9441751b0 0x7fa944180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.167 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.158+0000 7fa94a386700 1 --2- 172.21.15.159:0/1903756865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa944175590 0x7fa944180b60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.167 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.158+0000 7fa94a386700 1 -- 172.21.15.159:0/1903756865 >> 172.21.15.159:0/1903756865 conn(0x7fa94406a170 msgr2=0x7fa9440f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:25.167 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.158+0000 7fa94a386700 1 -- 172.21.15.159:0/1903756865 shutdown_connections 2022-09-17T10:27:25.167 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.158+0000 7fa94a386700 1 -- 172.21.15.159:0/1903756865 wait complete. 2022-09-17T10:27:25.170 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.160+0000 7fa94a386700 1 Processor -- start 2022-09-17T10:27:25.171 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.160+0000 7fa94a386700 1 -- start start 2022-09-17T10:27:25.171 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa94a386700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9441751b0 0x7fa9441691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.171 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa94a386700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa944175590 0x7fa9440cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.171 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa94a386700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa944181050 0x7fa9440cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa94a386700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440cc990 con 0x7fa944175590 2022-09-17T10:27:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa94a386700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440cb810 con 0x7fa944181050 2022-09-17T10:27:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa94a386700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440cbaa0 con 0x7fa9441751b0 2022-09-17T10:27:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9441751b0 0x7fa9441691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9441751b0 0x7fa9441691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46938/0 (socket says 172.21.15.159:46938) 2022-09-17T10:27:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 -- 172.21.15.159:0/3859780976 learned_addr learned my addr 172.21.15.159:0/3859780976 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa948923700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa944181050 0x7fa9440cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa9437fe700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa944175590 0x7fa9440cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 -- 172.21.15.159:0/3859780976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa944181050 msgr2=0x7fa9440cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.174 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa944181050 0x7fa9440cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.174 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 -- 172.21.15.159:0/3859780976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa944175590 msgr2=0x7fa9440cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.174 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa944175590 0x7fa9440cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.174 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 -- 172.21.15.159:0/3859780976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934009370 con 0x7fa9441751b0 2022-09-17T10:27:25.175 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa943fff700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9441751b0 0x7fa9441691a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa93800e950 tx=0x7fa938009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:25.175 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa92bfff700 1 -- 172.21.15.159:0/3859780976 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938009530 con 0x7fa9441751b0 2022-09-17T10:27:25.176 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9440cbd80 con 0x7fa9441751b0 2022-09-17T10:27:25.176 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa92bfff700 1 -- 172.21.15.159:0/3859780976 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa938012600 con 0x7fa9441751b0 2022-09-17T10:27:25.176 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.161+0000 7fa92bfff700 1 -- 172.21.15.159:0/3859780976 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938012980 con 0x7fa9441751b0 2022-09-17T10:27:25.177 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.162+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9440cc340 con 0x7fa9441751b0 2022-09-17T10:27:25.177 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.162+0000 7fa92bfff700 1 -- 172.21.15.159:0/3859780976 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fa938022070 con 0x7fa9441751b0 2022-09-17T10:27:25.177 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.162+0000 7fa92bfff700 1 -- 172.21.15.159:0/3859780976 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fa938012db0 con 0x7fa9441751b0 2022-09-17T10:27:25.177 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.163+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9440c4670 con 0x7fa9441751b0 2022-09-17T10:27:25.178 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.165+0000 7fa92bfff700 1 -- 172.21.15.159:0/3859780976 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7fa93803ade0 con 0x7fa9441751b0 2022-09-17T10:27:25.191 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:25.190+0000 7f414c034680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-17T10:27:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.243+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1fb7510e-c67f-4523-8906-7fbe25054044", "id": 8} v 0) v1 -- 0x7fa94406bf40 con 0x7fa9441751b0 2022-09-17T10:27:25.249 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.246+0000 7fa92bfff700 1 -- 172.21.15.159:0/3859780976 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1fb7510e-c67f-4523-8906-7fbe25054044", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa938029030 con 0x7fa9441751b0 2022-09-17T10:27:25.249 INFO:teuthology.orchestra.run.smithi159.stdout:8 2022-09-17T10:27:25.251 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9441751b0 msgr2=0x7fa9441691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.251 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9441751b0 0x7fa9441691a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa93800e950 tx=0x7fa938009060).stop 2022-09-17T10:27:25.251 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 shutdown_connections 2022-09-17T10:27:25.252 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa944181050 0x7fa9440cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.252 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9441751b0 0x7fa9441691a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.252 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 --2- 172.21.15.159:0/3859780976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa944175590 0x7fa9440cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.252 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 >> 172.21.15.159:0/3859780976 conn(0x7fa94406a170 msgr2=0x7fa94416f420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:25.253 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 shutdown_connections 2022-09-17T10:27:25.253 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.247+0000 7fa94a386700 1 -- 172.21.15.159:0/3859780976 wait complete. 2022-09-17T10:27:25.265 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 387d2fbb-304c-4360-b0c2-9dbf6df590e7 9 2022-09-17T10:27:25.348 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:25.346+0000 7f63a4644680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-17T10:27:25.361 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:25.358+0000 7f3248a31680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-17T10:27:25.381 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.378+0000 7f89deddd700 1 Processor -- start 2022-09-17T10:27:25.382 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.378+0000 7f89deddd700 1 -- start start 2022-09-17T10:27:25.385 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.379+0000 7f89deddd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f89d80eb720 0x7f89d80edb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.379+0000 7f89deddd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80ef6d0 con 0x7f89d817dd90 2022-09-17T10:27:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.379+0000 7f89deddd700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80eeb50 con 0x7f89d80edff0 2022-09-17T10:27:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.379+0000 7f89deddd700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d80eee30 con 0x7f89d80eb720 2022-09-17T10:27:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89ddddb700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f89d817dd90 0x7f89d80eb010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.159:35826/0 (socket says 172.21.15.159:35826) 2022-09-17T10:27:25.387 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89ddddb700 1 -- 172.21.15.159:0/1214040258 learned_addr learned my addr 172.21.15.159:0/1214040258 (peer_addr_for_me v1:172.21.15.159:0/0) 2022-09-17T10:27:25.387 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dd5da700 1 --2- 172.21.15.159:0/1214040258 >> v2:172.21.15.93:3300/0 conn(0x7f89d80eb720 0x7f89d80edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.387 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89de5dc700 1 --1- 172.21.15.159:0/1214040258 >> v1:172.21.15.93:6789/0 conn(0x7f89d80edff0 0x7f89d80e6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.159:53572/0 (socket says 172.21.15.159:53572) 2022-09-17T10:27:25.387 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dcdd9700 1 -- 172.21.15.159:0/1214040258 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913620184 0 0) 0x7f89c8001110 con 0x7f89d817dd90 2022-09-17T10:27:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dcdd9700 1 -- 172.21.15.159:0/1214040258 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c00033f0 con 0x7f89d817dd90 2022-09-17T10:27:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dd5da700 1 -- 172.21.15.159:0/1214040258 >> v1:172.21.15.93:6789/0 conn(0x7f89d80edff0 legacy=0x7f89d80e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dcdd9700 1 -- 172.21.15.159:0/1214040258 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654897554 0 0) 0x7f89d80eeb50 con 0x7f89d80edff0 2022-09-17T10:27:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dd5da700 1 -- 172.21.15.159:0/1214040258 >> v1:172.21.15.62:6789/0 conn(0x7f89d817dd90 legacy=0x7f89d80eb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dd5da700 1 -- 172.21.15.159:0/1214040258 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80ef110 con 0x7f89d80eb720 2022-09-17T10:27:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dd5da700 1 --2- 172.21.15.159:0/1214040258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 0x7f89d80edb00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f89d4009760 tx=0x7f89d4009060).ready entity=mon.1 client_cookie=46d8824cc5441ee1 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dcdd9700 1 -- 172.21.15.159:0/1214040258 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400f510 con 0x7f89d80eb720 2022-09-17T10:27:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dcdd9700 1 -- 172.21.15.159:0/1214040258 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400f670 con 0x7f89d80eb720 2022-09-17T10:27:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.380+0000 7f89dcdd9700 1 -- 172.21.15.159:0/1214040258 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400f9f0 con 0x7f89d80eb720 2022-09-17T10:27:25.390 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.381+0000 7f89deddd700 1 -- 172.21.15.159:0/1214040258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 msgr2=0x7f89d80edb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.390 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.381+0000 7f89deddd700 1 --2- 172.21.15.159:0/1214040258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 0x7f89d80edb00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f89d4009760 tx=0x7f89d4009060).stop 2022-09-17T10:27:25.390 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.381+0000 7f89deddd700 1 -- 172.21.15.159:0/1214040258 shutdown_connections 2022-09-17T10:27:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.381+0000 7f89deddd700 1 --2- 172.21.15.159:0/1214040258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 0x7f89d80edb00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.381+0000 7f89deddd700 1 -- 172.21.15.159:0/1214040258 >> 172.21.15.159:0/1214040258 conn(0x7f89d80e62e0 msgr2=0x7f89d80e66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.381+0000 7f89deddd700 1 -- 172.21.15.159:0/1214040258 shutdown_connections 2022-09-17T10:27:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.381+0000 7f89deddd700 1 -- 172.21.15.159:0/1214040258 wait complete. 2022-09-17T10:27:25.392 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.383+0000 7f89deddd700 1 Processor -- start 2022-09-17T10:27:25.392 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.383+0000 7f89deddd700 1 -- start start 2022-09-17T10:27:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89deddd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 0x7f89d8168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89deddd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89d80edff0 0x7f89d8191dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89deddd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89d817dd90 0x7f89d81922c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.396 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89deddd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80bc020 con 0x7f89d817dd90 2022-09-17T10:27:25.396 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89deddd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80bb450 con 0x7f89d80eb720 2022-09-17T10:27:25.396 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89deddd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d8192c70 con 0x7f89d80edff0 2022-09-17T10:27:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89d80edff0 0x7f89d8191dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89ddddb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 0x7f89d8168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89d80edff0 0x7f89d8191dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46950/0 (socket says 172.21.15.159:46950) 2022-09-17T10:27:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 -- 172.21.15.159:0/3014790720 learned_addr learned my addr 172.21.15.159:0/3014790720 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89de5dc700 1 --2- 172.21.15.159:0/3014790720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89d817dd90 0x7f89d81922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 -- 172.21.15.159:0/3014790720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 msgr2=0x7f89d8168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 --2- 172.21.15.159:0/3014790720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 0x7f89d8168260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 -- 172.21.15.159:0/3014790720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89d817dd90 msgr2=0x7f89d81922c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 --2- 172.21.15.159:0/3014790720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89d817dd90 0x7f89d81922c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 -- 172.21.15.159:0/3014790720 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d40092a0 con 0x7f89d80edff0 2022-09-17T10:27:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89dd5da700 1 --2- 172.21.15.159:0/3014790720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89d80edff0 0x7f89d8191dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f89d4009e00 tx=0x7f89d4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89c5ffb700 1 -- 172.21.15.159:0/3014790720 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400f7e0 con 0x7f89d80edff0 2022-09-17T10:27:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89c5ffb700 1 -- 172.21.15.159:0/3014790720 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400f940 con 0x7f89d80edff0 2022-09-17T10:27:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d80bb6f0 con 0x7f89d80edff0 2022-09-17T10:27:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.384+0000 7f89c5ffb700 1 -- 172.21.15.159:0/3014790720 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d401b660 con 0x7f89d80edff0 2022-09-17T10:27:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.385+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d80bbcb0 con 0x7f89d80edff0 2022-09-17T10:27:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.385+0000 7f89c5ffb700 1 -- 172.21.15.159:0/3014790720 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f89d402b070 con 0x7f89d80edff0 2022-09-17T10:27:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.385+0000 7f89c5ffb700 1 -- 172.21.15.159:0/3014790720 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7f89d4024bc0 con 0x7f89d80edff0 2022-09-17T10:27:25.401 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.385+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d806be90 con 0x7f89d80edff0 2022-09-17T10:27:25.401 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.387+0000 7f89c5ffb700 1 -- 172.21.15.159:0/3014790720 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f89d4029060 con 0x7f89d80edff0 2022-09-17T10:27:25.470 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.467+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "387d2fbb-304c-4360-b0c2-9dbf6df590e7", "id": 9} v 0) v1 -- 0x7f89d80ef3f0 con 0x7f89d80edff0 2022-09-17T10:27:25.473 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.470+0000 7f89c5ffb700 1 -- 172.21.15.159:0/3014790720 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "387d2fbb-304c-4360-b0c2-9dbf6df590e7", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89d401f070 con 0x7f89d80edff0 2022-09-17T10:27:25.473 INFO:teuthology.orchestra.run.smithi159.stdout:9 2022-09-17T10:27:25.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89d80edff0 msgr2=0x7f89d8191dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 --2- 172.21.15.159:0/3014790720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89d80edff0 0x7f89d8191dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f89d4009e00 tx=0x7f89d4017000).stop 2022-09-17T10:27:25.475 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 shutdown_connections 2022-09-17T10:27:25.476 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 --2- 172.21.15.159:0/3014790720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89d80eb720 0x7f89d8168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.478 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 --2- 172.21.15.159:0/3014790720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89d817dd90 0x7f89d81922c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.478 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 --2- 172.21.15.159:0/3014790720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89d80edff0 0x7f89d8191dd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.479 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 >> 172.21.15.159:0/3014790720 conn(0x7f89d80e62e0 msgr2=0x7f89d80e0010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:25.479 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 shutdown_connections 2022-09-17T10:27:25.479 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.471+0000 7f89deddd700 1 -- 172.21.15.159:0/3014790720 wait complete. 2022-09-17T10:27:25.487 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new c2e80d24-b7e8-4141-b276-c2140a4ccdca 10 2022-09-17T10:27:25.602 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.599+0000 7feabeef0700 1 Processor -- start 2022-09-17T10:27:25.602 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.599+0000 7feabeef0700 1 -- start start 2022-09-17T10:27:25.605 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabeef0700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7feab8062950 0x7feab8062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.605 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabeef0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80c6dd0 con 0x7feab81751b0 2022-09-17T10:27:25.606 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabeef0700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80642c0 con 0x7feab8175590 2022-09-17T10:27:25.606 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabeef0700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80f10e0 con 0x7feab8062950 2022-09-17T10:27:25.606 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabd48d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7feab8062950 0x7feab8062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.606 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabd48d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7feab8062950 0x7feab8062dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46962/0 (socket says 172.21.15.159:46962) 2022-09-17T10:27:25.607 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabd48d700 1 -- 172.21.15.159:0/2227137464 learned_addr learned my addr 172.21.15.159:0/2227137464 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:25.607 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabd48d700 1 -- 172.21.15.159:0/2227137464 >> v1:172.21.15.93:6789/0 conn(0x7feab8175590 legacy=0x7feab8180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.607 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabd48d700 1 -- 172.21.15.159:0/2227137464 >> v1:172.21.15.62:6789/0 conn(0x7feab81751b0 legacy=0x7feab8180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.607 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.600+0000 7feabd48d700 1 -- 172.21.15.159:0/2227137464 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab81801e0 con 0x7feab8062950 2022-09-17T10:27:25.608 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feabd48d700 1 --2- 172.21.15.159:0/2227137464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8062950 0x7feab8062dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7feab0009f20 tx=0x7feab0009840).ready entity=mon.2 client_cookie=11adbfbf05587dff server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:25.608 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feab77fe700 1 -- 172.21.15.159:0/2227137464 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000e070 con 0x7feab8062950 2022-09-17T10:27:25.609 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feab77fe700 1 -- 172.21.15.159:0/2227137464 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab000ba80 con 0x7feab8062950 2022-09-17T10:27:25.609 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feab77fe700 1 -- 172.21.15.159:0/2227137464 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000be00 con 0x7feab8062950 2022-09-17T10:27:25.609 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feabeef0700 1 -- 172.21.15.159:0/2227137464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8062950 msgr2=0x7feab8062dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.609 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feabeef0700 1 --2- 172.21.15.159:0/2227137464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8062950 0x7feab8062dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7feab0009f20 tx=0x7feab0009840).stop 2022-09-17T10:27:25.610 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feabeef0700 1 -- 172.21.15.159:0/2227137464 shutdown_connections 2022-09-17T10:27:25.611 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feabeef0700 1 --2- 172.21.15.159:0/2227137464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8062950 0x7feab8062dc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.611 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feabeef0700 1 -- 172.21.15.159:0/2227137464 >> 172.21.15.159:0/2227137464 conn(0x7feab806a170 msgr2=0x7feab80f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:25.611 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feabeef0700 1 -- 172.21.15.159:0/2227137464 shutdown_connections 2022-09-17T10:27:25.612 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.601+0000 7feabeef0700 1 -- 172.21.15.159:0/2227137464 wait complete. 2022-09-17T10:27:25.612 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.603+0000 7feabeef0700 1 Processor -- start 2022-09-17T10:27:25.615 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.603+0000 7feabeef0700 1 -- start start 2022-09-17T10:27:25.616 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabeef0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feab8062950 0x7feab8178f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.616 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabeef0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feab81751b0 0x7feab816d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.616 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabeef0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8175590 0x7feab816de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.616 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabeef0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab80f0660 con 0x7feab8062950 2022-09-17T10:27:25.617 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabeef0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab817a420 con 0x7feab81751b0 2022-09-17T10:27:25.617 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabeef0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8179530 con 0x7feab8175590 2022-09-17T10:27:25.617 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabd48d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8175590 0x7feab816de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.618 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabd48d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8175590 0x7feab816de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46978/0 (socket says 172.21.15.159:46978) 2022-09-17T10:27:25.618 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabd48d700 1 -- 172.21.15.159:0/3660927274 learned_addr learned my addr 172.21.15.159:0/3660927274 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:25.618 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabcc8c700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feab8062950 0x7feab8178f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.618 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feab7fff700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feab81751b0 0x7feab816d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.619 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabd48d700 1 -- 172.21.15.159:0/3660927274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feab81751b0 msgr2=0x7feab816d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.619 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabd48d700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feab81751b0 0x7feab816d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.619 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabd48d700 1 -- 172.21.15.159:0/3660927274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feab8062950 msgr2=0x7feab8178f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.619 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabd48d700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feab8062950 0x7feab8178f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.619 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabd48d700 1 -- 172.21.15.159:0/3660927274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0009ae0 con 0x7feab8175590 2022-09-17T10:27:25.620 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.604+0000 7feabcc8c700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feab8062950 0x7feab8178f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:27:25.620 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.605+0000 7feabd48d700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8175590 0x7feab816de60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7feab000b6c0 tx=0x7feab8180150).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:25.620 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.605+0000 7feab4ff9700 1 -- 172.21.15.159:0/3660927274 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0013ea0 con 0x7feab8175590 2022-09-17T10:27:25.620 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.605+0000 7feab4ff9700 1 -- 172.21.15.159:0/3660927274 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab00092e0 con 0x7feab8175590 2022-09-17T10:27:25.621 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.605+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab8179810 con 0x7feab8175590 2022-09-17T10:27:25.621 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.605+0000 7feab4ff9700 1 -- 172.21.15.159:0/3660927274 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab001e6a0 con 0x7feab8175590 2022-09-17T10:27:25.621 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.605+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab8179dd0 con 0x7feab8175590 2022-09-17T10:27:25.621 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.605+0000 7feab4ff9700 1 -- 172.21.15.159:0/3660927274 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7feab0025030 con 0x7feab8175590 2022-09-17T10:27:25.621 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.605+0000 7feab4ff9700 1 -- 172.21.15.159:0/3660927274 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1904+0+0 (secure 0 0 0) 0x7feab0028d60 con 0x7feab8175590 2022-09-17T10:27:25.622 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.606+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab817a590 con 0x7feab8175590 2022-09-17T10:27:25.622 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.608+0000 7feab4ff9700 1 -- 172.21.15.159:0/3660927274 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7feab002d060 con 0x7feab8175590 2022-09-17T10:27:25.689 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.686+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c2e80d24-b7e8-4141-b276-c2140a4ccdca", "id": 10} v 0) v1 -- 0x7feab806bf40 con 0x7feab8175590 2022-09-17T10:27:25.692 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.690+0000 7feab4ff9700 1 -- 172.21.15.159:0/3660927274 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c2e80d24-b7e8-4141-b276-c2140a4ccdca", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7feab0023070 con 0x7feab8175590 2022-09-17T10:27:25.694 INFO:teuthology.orchestra.run.smithi159.stdout:10 2022-09-17T10:27:25.697 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8175590 msgr2=0x7feab816de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.697 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8175590 0x7feab816de60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7feab000b6c0 tx=0x7feab8180150).stop 2022-09-17T10:27:25.697 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 shutdown_connections 2022-09-17T10:27:25.697 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feab8175590 0x7feab816de60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feab8062950 0x7feab8178f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 --2- 172.21.15.159:0/3660927274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feab81751b0 0x7feab816d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 >> 172.21.15.159:0/3660927274 conn(0x7feab806a170 msgr2=0x7feab817f070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 shutdown_connections 2022-09-17T10:27:25.699 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.691+0000 7feabeef0700 1 -- 172.21.15.159:0/3660927274 wait complete. 2022-09-17T10:27:25.705 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new e881702a-da6a-4d37-873b-4d8edd7eecbb 11 2022-09-17T10:27:25.820 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.817+0000 7f89e6bb8700 1 Processor -- start 2022-09-17T10:27:25.820 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.817+0000 7f89e6bb8700 1 -- start start 2022-09-17T10:27:25.828 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.818+0000 7f89e6bb8700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89e0175430 0x7f89e017a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.828 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.818+0000 7f89e6bb8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e0178e50 con 0x7f89e0175050 2022-09-17T10:27:25.828 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.818+0000 7f89e6bb8700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e017e0c0 con 0x7f89e0083880 2022-09-17T10:27:25.828 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.818+0000 7f89e6bb8700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e017e3a0 con 0x7f89e0175430 2022-09-17T10:27:25.829 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.818+0000 7f89dffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89e0175430 0x7f89e017a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.829 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.818+0000 7f89dffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89e0175430 0x7f89e017a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46994/0 (socket says 172.21.15.159:46994) 2022-09-17T10:27:25.829 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.818+0000 7f89e5155700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f89e0083880 0x7f89e0083cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:59086/0 (socket says 172.21.15.159:59086) 2022-09-17T10:27:25.829 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.818+0000 7f89dffff700 1 -- 172.21.15.159:0/4253484121 learned_addr learned my addr 172.21.15.159:0/4253484121 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:25.830 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89dffff700 1 -- 172.21.15.159:0/4253484121 >> v1:172.21.15.159:6789/0 conn(0x7f89e0083880 legacy=0x7f89e0083cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.830 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89dffff700 1 -- 172.21.15.159:0/4253484121 >> v1:172.21.15.62:6789/0 conn(0x7f89e0175050 legacy=0x7f89e0179b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.830 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89dffff700 1 -- 172.21.15.159:0/4253484121 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e01790a0 con 0x7f89e0175430 2022-09-17T10:27:25.830 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89dffff700 1 --2- 172.21.15.159:0/4253484121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175430 0x7f89e017a290 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f89cc006fd0 tx=0x7f89cc0090f0).ready entity=mon.2 client_cookie=daf4a45e7ad74fe6 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:25.831 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89df7fe700 1 -- 172.21.15.159:0/4253484121 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00b600 con 0x7f89e0175430 2022-09-17T10:27:25.831 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89df7fe700 1 -- 172.21.15.159:0/4253484121 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc00b760 con 0x7f89e0175430 2022-09-17T10:27:25.831 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89df7fe700 1 -- 172.21.15.159:0/4253484121 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00bb00 con 0x7f89e0175430 2022-09-17T10:27:25.832 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89e6bb8700 1 -- 172.21.15.159:0/4253484121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175430 msgr2=0x7f89e017a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.832 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89e6bb8700 1 --2- 172.21.15.159:0/4253484121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175430 0x7f89e017a290 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f89cc006fd0 tx=0x7f89cc0090f0).stop 2022-09-17T10:27:25.832 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89e6bb8700 1 -- 172.21.15.159:0/4253484121 shutdown_connections 2022-09-17T10:27:25.833 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89e6bb8700 1 --2- 172.21.15.159:0/4253484121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175430 0x7f89e017a290 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.833 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89e6bb8700 1 -- 172.21.15.159:0/4253484121 >> 172.21.15.159:0/4253484121 conn(0x7f89e006a160 msgr2=0x7f89e005d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:25.833 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89e6bb8700 1 -- 172.21.15.159:0/4253484121 shutdown_connections 2022-09-17T10:27:25.833 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.819+0000 7f89e6bb8700 1 -- 172.21.15.159:0/4253484121 wait complete. 2022-09-17T10:27:25.833 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.821+0000 7f89e6bb8700 1 Processor -- start 2022-09-17T10:27:25.834 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.821+0000 7f89e6bb8700 1 -- start start 2022-09-17T10:27:25.834 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89e6bb8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e0083880 0x7f89e017d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.834 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89e6bb8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175050 0x7f89e0152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.834 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89e6bb8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89e0175430 0x7f89e01758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:25.835 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89e6bb8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00ca3e0 con 0x7f89e0083880 2022-09-17T10:27:25.835 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89e6bb8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e017d180 con 0x7f89e0175430 2022-09-17T10:27:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89e6bb8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e017db00 con 0x7f89e0175050 2022-09-17T10:27:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175050 0x7f89e0152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175050 0x7f89e0152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47000/0 (socket says 172.21.15.159:47000) 2022-09-17T10:27:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 -- 172.21.15.159:0/275934614 learned_addr learned my addr 172.21.15.159:0/275934614 (peer_addr_for_me v2:172.21.15.159:0/0) 2022-09-17T10:27:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89e4954700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e0083880 0x7f89e017d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89e5155700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89e0175430 0x7f89e01758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 -- 172.21.15.159:0/275934614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89e0175430 msgr2=0x7f89e01758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89e0175430 0x7f89e01758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 -- 172.21.15.159:0/275934614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e0083880 msgr2=0x7f89e017d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.838 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e0083880 0x7f89e017d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.838 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 -- 172.21.15.159:0/275934614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc009370 con 0x7f89e0175050 2022-09-17T10:27:25.838 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.822+0000 7f89dffff700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175050 0x7f89e0152c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f89cc006b50 tx=0x7f89cc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:25.838 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.823+0000 7f89dcff9700 1 -- 172.21.15.159:0/275934614 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00b8d0 con 0x7f89e0175050 2022-09-17T10:27:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.823+0000 7f89dcff9700 1 -- 172.21.15.159:0/275934614 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc00ba30 con 0x7f89e0175050 2022-09-17T10:27:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.823+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e017c570 con 0x7f89e0175050 2022-09-17T10:27:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.823+0000 7f89dcff9700 1 -- 172.21.15.159:0/275934614 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc025420 con 0x7f89e0175050 2022-09-17T10:27:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.823+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e017cb30 con 0x7f89e0175050 2022-09-17T10:27:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.823+0000 7f89dcff9700 1 -- 172.21.15.159:0/275934614 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f89cc02c070 con 0x7f89e0175050 2022-09-17T10:27:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.823+0000 7f89dcff9700 1 -- 172.21.15.159:0/275934614 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2019+0+0 (secure 0 0 0) 0x7f89cc01cc80 con 0x7f89e0175050 2022-09-17T10:27:25.841 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.824+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e00ca580 con 0x7f89e0175050 2022-09-17T10:27:25.841 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.826+0000 7f89dcff9700 1 -- 172.21.15.159:0/275934614 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7f89cc02a060 con 0x7f89e0175050 2022-09-17T10:27:25.846 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:25.844+0000 7f414c034680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-17T10:27:25.908 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.905+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e881702a-da6a-4d37-873b-4d8edd7eecbb", "id": 11} v 0) v1 -- 0x7f89e0179380 con 0x7f89e0175050 2022-09-17T10:27:25.911 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.908+0000 7f89dcff9700 1 -- 172.21.15.159:0/275934614 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e881702a-da6a-4d37-873b-4d8edd7eecbb", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7f89cc025a70 con 0x7f89e0175050 2022-09-17T10:27:25.912 INFO:teuthology.orchestra.run.smithi159.stdout:11 2022-09-17T10:27:25.915 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175050 msgr2=0x7f89e0152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:25.916 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175050 0x7f89e0152c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f89cc006b50 tx=0x7f89cc017000).stop 2022-09-17T10:27:25.916 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 shutdown_connections 2022-09-17T10:27:25.917 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89e0175430 0x7f89e01758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.917 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e0083880 0x7f89e017d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.918 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 --2- 172.21.15.159:0/275934614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89e0175050 0x7f89e0152c00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:25.919 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 >> 172.21.15.159:0/275934614 conn(0x7f89e006a160 msgr2=0x7f89e017eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:25.919 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 shutdown_connections 2022-09-17T10:27:25.920 INFO:teuthology.orchestra.run.smithi159.stderr:2022-09-17T10:27:25.909+0000 7f89e6bb8700 1 -- 172.21.15.159:0/275934614 wait complete. 2022-09-17T10:27:25.921 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:25.911+0000 7f414c034680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-17T10:27:25.925 INFO:tasks.ceph.osd.0:Restarting daemon 2022-09-17T10:27:25.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-09-17T10:27:25.929 INFO:tasks.ceph.osd.0:Started 2022-09-17T10:27:25.930 INFO:tasks.ceph.osd.3:Restarting daemon 2022-09-17T10:27:25.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-09-17T10:27:25.932 INFO:tasks.ceph.osd.3:Started 2022-09-17T10:27:25.933 INFO:tasks.ceph.osd.6:Restarting daemon 2022-09-17T10:27:25.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-09-17T10:27:25.936 INFO:tasks.ceph.osd.6:Started 2022-09-17T10:27:25.936 INFO:tasks.ceph.osd.9:Restarting daemon 2022-09-17T10:27:25.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2022-09-17T10:27:25.939 INFO:tasks.ceph.osd.9:Started 2022-09-17T10:27:25.939 INFO:tasks.ceph.osd.1:Restarting daemon 2022-09-17T10:27:25.940 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-09-17T10:27:25.943 INFO:tasks.ceph.osd.1:Started 2022-09-17T10:27:25.943 INFO:tasks.ceph.osd.4:Restarting daemon 2022-09-17T10:27:25.944 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-09-17T10:27:25.946 INFO:tasks.ceph.osd.4:Started 2022-09-17T10:27:25.946 INFO:tasks.ceph.osd.7:Restarting daemon 2022-09-17T10:27:25.947 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-09-17T10:27:25.950 INFO:tasks.ceph.osd.7:Started 2022-09-17T10:27:25.950 INFO:tasks.ceph.osd.10:Restarting daemon 2022-09-17T10:27:25.951 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2022-09-17T10:27:25.954 INFO:tasks.ceph.osd.10:Started 2022-09-17T10:27:25.954 INFO:tasks.ceph.osd.2:Restarting daemon 2022-09-17T10:27:25.955 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-09-17T10:27:25.958 INFO:tasks.ceph.osd.2:Started 2022-09-17T10:27:25.958 INFO:tasks.ceph.osd.5:Restarting daemon 2022-09-17T10:27:25.959 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-09-17T10:27:25.962 INFO:tasks.ceph.osd.5:Started 2022-09-17T10:27:25.963 INFO:tasks.ceph.osd.8:Restarting daemon 2022-09-17T10:27:25.964 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2022-09-17T10:27:25.967 INFO:tasks.ceph.osd.8:Started 2022-09-17T10:27:25.968 INFO:tasks.ceph.osd.11:Restarting daemon 2022-09-17T10:27:25.969 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2022-09-17T10:27:25.972 INFO:tasks.ceph.osd.11:Started 2022-09-17T10:27:25.973 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:26.015 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:26.014+0000 7f414c034680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-17T10:27:26.071 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:26.068+0000 7f63a4644680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-17T10:27:26.088 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:26.085+0000 7f3248a31680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-17T10:27:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.106+0000 7feac19bf700 1 Processor -- start 2022-09-17T10:27:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.106+0000 7feac19bf700 1 -- start start 2022-09-17T10:27:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.107+0000 7feac19bf700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7feabc1751b0 0x7feabc180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.107+0000 7feac19bf700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feabc0ef650 0x7feabc0efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.107+0000 7feac19bf700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc0c6dd0 con 0x7feabc175590 2022-09-17T10:27:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.107+0000 7feac19bf700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc0f10e0 con 0x7feabc0ef650 2022-09-17T10:27:26.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.107+0000 7feac19bf700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc1801e0 con 0x7feabc1751b0 2022-09-17T10:27:26.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.107+0000 7feabb7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feabc0ef650 0x7feabc0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:26.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feaba7fc700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7feabc175590 0x7feabc180b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.62:35786/0 (socket says 172.21.15.62:35786) 2022-09-17T10:27:26.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feabb7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feabc0ef650 0x7feabc0efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.62:56510/0 (socket says 172.21.15.62:56510) 2022-09-17T10:27:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feaba7fc700 1 -- 172.21.15.62:0/4162294504 learned_addr learned my addr 172.21.15.62:0/4162294504 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feabaffd700 1 --2- 172.21.15.62:0/4162294504 >> v2:172.21.15.159:3300/0 conn(0x7feabc1751b0 0x7feabc180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feabb7fe700 1 -- 172.21.15.62:0/4162294504 >> v2:172.21.15.159:3300/0 conn(0x7feabc1751b0 msgr2=0x7feabc180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feabb7fe700 1 --2- 172.21.15.62:0/4162294504 >> v2:172.21.15.159:3300/0 conn(0x7feabc1751b0 0x7feabc180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feabb7fe700 1 -- 172.21.15.62:0/4162294504 >> v1:172.21.15.93:6789/0 conn(0x7feabc175590 legacy=0x7feabc180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feab9ffb700 1 -- 172.21.15.62:0/4162294504 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949751196 0 0) 0x7feabc0c6dd0 con 0x7feabc175590 2022-09-17T10:27:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feabb7fe700 1 -- 172.21.15.62:0/4162294504 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc0f0840 con 0x7feabc0ef650 2022-09-17T10:27:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feabaffd700 1 --2- 172.21.15.62:0/4162294504 >> v2:172.21.15.159:3300/0 conn(0x7feabc1751b0 0x7feabc180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:27:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feabb7fe700 1 --2- 172.21.15.62:0/4162294504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc0efa90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7feabc088880 tx=0x7feab4009780).ready entity=mon.1 client_cookie=7b71b3b1ddd3ce52 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feab9ffb700 1 -- 172.21.15.62:0/4162294504 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400e070 con 0x7feabc0ef650 2022-09-17T10:27:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feab9ffb700 1 -- 172.21.15.62:0/4162294504 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab400bb60 con 0x7feabc0ef650 2022-09-17T10:27:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.108+0000 7feab9ffb700 1 -- 172.21.15.62:0/4162294504 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4012410 con 0x7feabc0ef650 2022-09-17T10:27:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.109+0000 7feac19bf700 1 -- 172.21.15.62:0/4162294504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 msgr2=0x7feabc0efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.109+0000 7feac19bf700 1 --2- 172.21.15.62:0/4162294504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc0efa90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7feabc088880 tx=0x7feab4009780).stop 2022-09-17T10:27:26.118 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.109+0000 7feac19bf700 1 -- 172.21.15.62:0/4162294504 shutdown_connections 2022-09-17T10:27:26.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.109+0000 7feac19bf700 1 --2- 172.21.15.62:0/4162294504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc0efa90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:26.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.109+0000 7feac19bf700 1 --2- 172.21.15.62:0/4162294504 >> v2:172.21.15.159:3300/0 conn(0x7feabc1751b0 0x7feabc180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:26.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.109+0000 7feac19bf700 1 -- 172.21.15.62:0/4162294504 >> 172.21.15.62:0/4162294504 conn(0x7feabc06a170 msgr2=0x7feabc0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:26.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.109+0000 7feac19bf700 1 -- 172.21.15.62:0/4162294504 shutdown_connections 2022-09-17T10:27:26.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.109+0000 7feac19bf700 1 -- 172.21.15.62:0/4162294504 wait complete. 2022-09-17T10:27:26.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.110+0000 7feac19bf700 1 Processor -- start 2022-09-17T10:27:26.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.110+0000 7feac19bf700 1 -- start start 2022-09-17T10:27:26.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feac19bf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc18fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:26.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feac19bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc1751b0 0x7feabc16e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:26.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feac19bf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc175590 0x7feabc17dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:26.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feac19bf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc190230 con 0x7feabc1751b0 2022-09-17T10:27:26.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feac19bf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc17ccf0 con 0x7feabc0ef650 2022-09-17T10:27:26.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feac19bf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc17d870 con 0x7feabc175590 2022-09-17T10:27:26.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feaba7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc1751b0 0x7feabc16e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:26.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feabaffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc18fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:26.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feabaffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc18fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.62:56522/0 (socket says 172.21.15.62:56522) 2022-09-17T10:27:26.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feaba7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc1751b0 0x7feabc16e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41424/0 (socket says 172.21.15.62:41424) 2022-09-17T10:27:26.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.111+0000 7feabaffd700 1 -- 172.21.15.62:0/1070993164 learned_addr learned my addr 172.21.15.62:0/1070993164 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:26.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feabb7fe700 1 --2- 172.21.15.62:0/1070993164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc175590 0x7feabc17dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:26.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feabaffd700 1 -- 172.21.15.62:0/1070993164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc175590 msgr2=0x7feabc17dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feabaffd700 1 --2- 172.21.15.62:0/1070993164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc175590 0x7feabc17dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feabaffd700 1 -- 172.21.15.62:0/1070993164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc1751b0 msgr2=0x7feabc16e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feabaffd700 1 --2- 172.21.15.62:0/1070993164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc1751b0 0x7feabc16e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:26.140 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feabaffd700 1 -- 172.21.15.62:0/1070993164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40092a0 con 0x7feabc0ef650 2022-09-17T10:27:26.140 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feabaffd700 1 --2- 172.21.15.62:0/1070993164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc18fd40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7feaa400ea20 tx=0x7feaa4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:26.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feab2ffd700 1 -- 172.21.15.62:0/1070993164 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400ee60 con 0x7feabc0ef650 2022-09-17T10:27:26.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feab2ffd700 1 -- 172.21.15.62:0/1070993164 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400c850 con 0x7feabc0ef650 2022-09-17T10:27:26.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab4009a20 con 0x7feabc0ef650 2022-09-17T10:27:26.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feab2ffd700 1 -- 172.21.15.62:0/1070993164 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400cbd0 con 0x7feabc0ef650 2022-09-17T10:27:26.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc176d80 con 0x7feabc0ef650 2022-09-17T10:27:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feab2ffd700 1 -- 172.21.15.62:0/1070993164 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7feaa4022070 con 0x7feabc0ef650 2022-09-17T10:27:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.112+0000 7feab2ffd700 1 -- 172.21.15.62:0/1070993164 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2134+0+0 (secure 0 0 0) 0x7feaa4012cc0 con 0x7feabc0ef650 2022-09-17T10:27:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.113+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc17db50 con 0x7feabc0ef650 2022-09-17T10:27:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.115+0000 7feab2ffd700 1 -- 172.21.15.62:0/1070993164 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7feaa403ade0 con 0x7feabc0ef650 2022-09-17T10:27:26.144 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:26.138+0000 7f63a4644680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-17T10:27:26.161 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:26.158+0000 7f3248a31680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-17T10:27:26.169 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:26.166+0000 7f414c034680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-17T10:27:26.186 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.183+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feabc06bf40 con 0x7feabc0ef650 2022-09-17T10:27:26.187 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.184+0000 7feab2ffd700 1 -- 172.21.15.62:0/1070993164 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9954 (secure 0 0 0) 0x7feaa4029030 con 0x7feabc0ef650 2022-09-17T10:27:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:26.188 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":14,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:25.907826+0000","last_up_change":"0.000000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:26.190 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 msgr2=0x7feabc18fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:26.190 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 --2- 172.21.15.62:0/1070993164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc18fd40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7feaa400ea20 tx=0x7feaa4009060).stop 2022-09-17T10:27:26.190 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 shutdown_connections 2022-09-17T10:27:26.191 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 --2- 172.21.15.62:0/1070993164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feabc0ef650 0x7feabc18fd40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:26.191 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 --2- 172.21.15.62:0/1070993164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc175590 0x7feabc17dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:26.192 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 --2- 172.21.15.62:0/1070993164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc1751b0 0x7feabc16e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:26.193 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 >> 172.21.15.62:0/1070993164 conn(0x7feabc06a170 msgr2=0x7feabc084d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:26.193 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 shutdown_connections 2022-09-17T10:27:26.194 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:26.185+0000 7feac19bf700 1 -- 172.21.15.62:0/1070993164 wait complete. 2022-09-17T10:27:26.201 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-09-17T10:27:26.201 INFO:tasks.ceph:Waiting for OSDs to come up 2022-09-17T10:27:26.219 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:26.216+0000 7f63a4644680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-17T10:27:26.238 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:26.236+0000 7f414c034680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-17T10:27:26.243 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:26.241+0000 7f3248a31680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-17T10:27:26.355 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:26.353+0000 7f414c034680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-17T10:27:26.368 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:26.365+0000 7f63a4644680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-17T10:27:26.397 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:26.394+0000 7f3248a31680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-17T10:27:26.438 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:26.435+0000 7f63a4644680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-17T10:27:26.468 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:26.459+0000 7f414c034680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-17T10:27:26.470 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:26.468+0000 7f3248a31680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-17T10:27:26.540 INFO:tasks.ceph.osd.4.smithi093.stderr:2022-09-17T10:27:26.538+0000 7f05a3fca200 -1 Falling back to public interface 2022-09-17T10:27:26.541 INFO:tasks.ceph.osd.0.smithi062.stderr:2022-09-17T10:27:26.537+0000 7f9028706200 -1 Falling back to public interface 2022-09-17T10:27:26.543 INFO:tasks.ceph.osd.9.smithi062.stderr:2022-09-17T10:27:26.540+0000 7f65bd320200 -1 Falling back to public interface 2022-09-17T10:27:26.544 INFO:tasks.ceph.osd.7.smithi093.stderr:2022-09-17T10:27:26.541+0000 7f66b36bc200 -1 Falling back to public interface 2022-09-17T10:27:26.544 INFO:tasks.ceph.osd.3.smithi062.stderr:2022-09-17T10:27:26.541+0000 7fdaf2ad0200 -1 Falling back to public interface 2022-09-17T10:27:26.547 INFO:tasks.ceph.osd.10.smithi093.stderr:2022-09-17T10:27:26.545+0000 7f47b6f8b200 -1 Falling back to public interface 2022-09-17T10:27:26.552 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T10:27:26.549+0000 7ff58ba56200 -1 Falling back to public interface 2022-09-17T10:27:26.552 INFO:tasks.ceph.osd.2.smithi159.stderr:2022-09-17T10:27:26.549+0000 7ff482f8a200 -1 Falling back to public interface 2022-09-17T10:27:26.553 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T10:27:26.549+0000 7ff585c1c700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2022-09-17T10:27:26.553 INFO:tasks.ceph.osd.1.smithi093.stderr:2022-09-17T10:27:26.551+0000 7fc1d4d9f200 -1 Falling back to public interface 2022-09-17T10:27:26.554 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:26.551+0000 7f63a4644680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-17T10:27:26.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2022-09-17T10:27:26.564+0000 7f28ab385200 -1 Falling back to public interface 2022-09-17T10:27:26.570 INFO:tasks.ceph.osd.11.smithi159.stderr:2022-09-17T10:27:26.567+0000 7f2276e7d200 -1 Falling back to public interface 2022-09-17T10:27:26.592 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:27:26.590+0000 7f3cb6330200 -1 Falling back to public interface 2022-09-17T10:27:26.595 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:26.592+0000 7f3248a31680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-17T10:27:26.667 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:26.664+0000 7f63a4644680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-17T10:27:26.707 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:26.704+0000 7f3248a31680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-17T10:27:26.784 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:26.782+0000 7f414c034680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-17T10:27:26.855 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:26.853+0000 7f414c034680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-17T10:27:26.988 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:26.985+0000 7f63a4644680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-17T10:27:27.041 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:27.035+0000 7f3248a31680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-17T10:27:27.066 INFO:tasks.ceph.mgr.z.smithi159.stderr:2022-09-17T10:27:27.056+0000 7f63a4644680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-17T10:27:27.112 INFO:tasks.ceph.mgr.x.smithi062.stderr:2022-09-17T10:27:27.109+0000 7f3248a31680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-17T10:27:27.413 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:27.522 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.519+0000 7faf21dc9700 1 Processor -- start 2022-09-17T10:27:27.523 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.519+0000 7faf21dc9700 1 -- start start 2022-09-17T10:27:27.532 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf21dc9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf1c0c81b0 0x7faf1c0c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:27.533 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf21dc9700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faf1c0ca6c0 0x7faf1c0cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:27.533 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf21dc9700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c0c9b70 con 0x7faf1c17e220 2022-09-17T10:27:27.533 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf21dc9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c0ca000 con 0x7faf1c0c81b0 2022-09-17T10:27:27.534 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf21dc9700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c17e600 con 0x7faf1c0ca6c0 2022-09-17T10:27:27.534 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf1c0c81b0 0x7faf1c0c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:27.534 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf1c0c81b0 0x7faf1c0c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41434/0 (socket says 172.21.15.62:41434) 2022-09-17T10:27:27.534 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1affd700 1 -- 172.21.15.62:0/1849175580 learned_addr learned my addr 172.21.15.62:0/1849175580 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:27.535 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1bfff700 1 --2- 172.21.15.62:0/1849175580 >> v2:172.21.15.159:3300/0 conn(0x7faf1c0ca6c0 0x7faf1c0cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:27.535 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1affd700 1 -- 172.21.15.62:0/1849175580 >> v2:172.21.15.159:3300/0 conn(0x7faf1c0ca6c0 msgr2=0x7faf1c0cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:27.535 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1affd700 1 --2- 172.21.15.62:0/1849175580 >> v2:172.21.15.159:3300/0 conn(0x7faf1c0ca6c0 0x7faf1c0cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:27.535 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1affd700 1 -- 172.21.15.62:0/1849175580 >> v1:172.21.15.159:6789/0 conn(0x7faf1c17e220 legacy=0x7faf1c17f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:27.536 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1affd700 1 -- 172.21.15.62:0/1849175580 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c0c8c80 con 0x7faf1c0c81b0 2022-09-17T10:27:27.536 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1bfff700 1 --2- 172.21.15.62:0/1849175580 >> v2:172.21.15.159:3300/0 conn(0x7faf1c0ca6c0 0x7faf1c0cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:27.536 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.520+0000 7faf1affd700 1 --2- 172.21.15.62:0/1849175580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c0c81b0 0x7faf1c0c8630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7faf1c087ae0 tx=0x7faf0c0090f0).ready entity=mon.0 client_cookie=d886e0879be5ac42 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:27.536 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf1a7fc700 1 -- 172.21.15.62:0/1849175580 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00b600 con 0x7faf1c0c81b0 2022-09-17T10:27:27.536 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf1a7fc700 1 -- 172.21.15.62:0/1849175580 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c00b760 con 0x7faf1c0c81b0 2022-09-17T10:27:27.537 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf1a7fc700 1 -- 172.21.15.62:0/1849175580 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00bae0 con 0x7faf1c0c81b0 2022-09-17T10:27:27.537 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf21dc9700 1 -- 172.21.15.62:0/1849175580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c0c81b0 msgr2=0x7faf1c0c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:27.537 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf21dc9700 1 --2- 172.21.15.62:0/1849175580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c0c81b0 0x7faf1c0c8630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7faf1c087ae0 tx=0x7faf0c0090f0).stop 2022-09-17T10:27:27.537 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf21dc9700 1 -- 172.21.15.62:0/1849175580 shutdown_connections 2022-09-17T10:27:27.538 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf21dc9700 1 --2- 172.21.15.62:0/1849175580 >> v2:172.21.15.159:3300/0 conn(0x7faf1c0ca6c0 0x7faf1c0cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:27.538 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf21dc9700 1 --2- 172.21.15.62:0/1849175580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c0c81b0 0x7faf1c0c8630 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:27.538 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf21dc9700 1 -- 172.21.15.62:0/1849175580 >> 172.21.15.62:0/1849175580 conn(0x7faf1c0f4c90 msgr2=0x7faf1c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:27.538 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf21dc9700 1 -- 172.21.15.62:0/1849175580 shutdown_connections 2022-09-17T10:27:27.539 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.521+0000 7faf21dc9700 1 -- 172.21.15.62:0/1849175580 wait complete. 2022-09-17T10:27:27.539 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.523+0000 7faf21dc9700 1 Processor -- start 2022-09-17T10:27:27.539 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.523+0000 7faf21dc9700 1 -- start start 2022-09-17T10:27:27.539 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf21dc9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf1c0c81b0 0x7faf1c192880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:27.540 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf21dc9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1c0ca6c0 0x7faf1c16ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:27.540 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf21dc9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c17e220 0x7faf1c063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:27.540 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf21dc9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c180e60 con 0x7faf1c17e220 2022-09-17T10:27:27.540 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf21dc9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c062ef0 con 0x7faf1c0c81b0 2022-09-17T10:27:27.541 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf21dc9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c063a50 con 0x7faf1c0ca6c0 2022-09-17T10:27:27.541 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c17e220 0x7faf1c063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:27.541 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c17e220 0x7faf1c063ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41444/0 (socket says 172.21.15.62:41444) 2022-09-17T10:27:27.541 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 -- 172.21.15.62:0/2979538018 learned_addr learned my addr 172.21.15.62:0/2979538018 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:27.542 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1affd700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1c0ca6c0 0x7faf1c16ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:27.543 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1b7fe700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf1c0c81b0 0x7faf1c192880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:27.543 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 -- 172.21.15.62:0/2979538018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1c0ca6c0 msgr2=0x7faf1c16ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:27.543 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1c0ca6c0 0x7faf1c16ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:27.544 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 -- 172.21.15.62:0/2979538018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf1c0c81b0 msgr2=0x7faf1c192880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:27.544 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf1c0c81b0 0x7faf1c192880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:27.545 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 -- 172.21.15.62:0/2979538018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c009370 con 0x7faf1c17e220 2022-09-17T10:27:27.545 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1b7fe700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf1c0c81b0 0x7faf1c192880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:27.546 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf1bfff700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c17e220 0x7faf1c063ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7faf1400d180 tx=0x7faf14009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:27.546 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf037fe700 1 -- 172.21.15.62:0/2979538018 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1400dd10 con 0x7faf1c17e220 2022-09-17T10:27:27.547 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf037fe700 1 -- 172.21.15.62:0/2979538018 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1400f040 con 0x7faf1c17e220 2022-09-17T10:27:27.547 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1c180b80 con 0x7faf1c17e220 2022-09-17T10:27:27.547 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf037fe700 1 -- 172.21.15.62:0/2979538018 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14013600 con 0x7faf1c17e220 2022-09-17T10:27:27.548 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.524+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c063400 con 0x7faf1c17e220 2022-09-17T10:27:27.548 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.525+0000 7faf037fe700 1 -- 172.21.15.62:0/2979538018 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 2) v1 ==== 37381+0+0 (secure 0 0 0) 0x7faf140139f0 con 0x7faf1c17e220 2022-09-17T10:27:27.548 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.525+0000 7faf037fe700 1 -- 172.21.15.62:0/2979538018 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2134+0+0 (secure 0 0 0) 0x7faf14041cd0 con 0x7faf1c17e220 2022-09-17T10:27:27.549 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.525+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c06bee0 con 0x7faf1c17e220 2022-09-17T10:27:27.549 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.528+0000 7faf037fe700 1 -- 172.21.15.62:0/2979538018 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73156 (secure 0 0 0) 0x7faf1401bd70 con 0x7faf1c17e220 2022-09-17T10:27:27.599 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.595+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf1c0c8f60 con 0x7faf1c17e220 2022-09-17T10:27:27.600 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.596+0000 7faf037fe700 1 -- 172.21.15.62:0/2979538018 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9954 (secure 0 0 0) 0x7faf1402b090 con 0x7faf1c17e220 2022-09-17T10:27:27.600 INFO:teuthology.misc.health.smithi062.stdout: 2022-09-17T10:27:27.601 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":14,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:25.907826+0000","last_up_change":"0.000000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:27.603 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c17e220 msgr2=0x7faf1c063ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:27.603 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c17e220 0x7faf1c063ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7faf1400d180 tx=0x7faf14009a50).stop 2022-09-17T10:27:27.604 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 shutdown_connections 2022-09-17T10:27:27.604 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf1c0c81b0 0x7faf1c192880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:27.604 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c17e220 0x7faf1c063ee0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:27.604 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 --2- 172.21.15.62:0/2979538018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1c0ca6c0 0x7faf1c16ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:27.605 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 >> 172.21.15.62:0/2979538018 conn(0x7faf1c0f4c90 msgr2=0x7faf1c184910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:27.605 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 shutdown_connections 2022-09-17T10:27:27.605 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:27.597+0000 7faf21dc9700 1 -- 172.21.15.62:0/2979538018 wait complete. 2022-09-17T10:27:27.610 DEBUG:teuthology.misc:0 of 12 OSDs are up 2022-09-17T10:27:27.885 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:27.880+0000 7f41022a8700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-09-17T10:27:27.886 INFO:tasks.ceph.mgr.y.smithi093.stderr:2022-09-17T10:27:27.880+0000 7f41022a8700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-09-17T10:27:29.787 INFO:tasks.ceph.osd.0.smithi062.stderr:2022-09-17T10:27:29.784+0000 7f9028706200 -1 osd.0 0 log_to_monitors {default=true} 2022-09-17T10:27:30.010 INFO:tasks.ceph.osd.9.smithi062.stderr:2022-09-17T10:27:30.008+0000 7f65bd320200 -1 osd.9 0 log_to_monitors {default=true} 2022-09-17T10:27:30.023 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T10:27:30.021+0000 7ff58ba56200 -1 osd.5 0 log_to_monitors {default=true} 2022-09-17T10:27:30.052 INFO:tasks.ceph.osd.10.smithi093.stderr:2022-09-17T10:27:30.051+0000 7f47b6f8b200 -1 osd.10 0 log_to_monitors {default=true} 2022-09-17T10:27:30.054 INFO:tasks.ceph.osd.3.smithi062.stderr:2022-09-17T10:27:30.051+0000 7fdaf2ad0200 -1 osd.3 0 log_to_monitors {default=true} 2022-09-17T10:27:30.069 INFO:tasks.ceph.osd.4.smithi093.stderr:2022-09-17T10:27:30.068+0000 7f05a3fca200 -1 osd.4 0 log_to_monitors {default=true} 2022-09-17T10:27:30.071 INFO:tasks.ceph.osd.2.smithi159.stderr:2022-09-17T10:27:30.069+0000 7ff482f8a200 -1 osd.2 0 log_to_monitors {default=true} 2022-09-17T10:27:30.072 INFO:tasks.ceph.osd.11.smithi159.stderr:2022-09-17T10:27:30.070+0000 7f2276e7d200 -1 osd.11 0 log_to_monitors {default=true} 2022-09-17T10:27:30.073 INFO:tasks.ceph.osd.7.smithi093.stderr:2022-09-17T10:27:30.072+0000 7f66b36bc200 -1 osd.7 0 log_to_monitors {default=true} 2022-09-17T10:27:30.079 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:27:30.076+0000 7f3cb6330200 -1 osd.8 0 log_to_monitors {default=true} 2022-09-17T10:27:30.081 INFO:tasks.ceph.osd.1.smithi093.stderr:2022-09-17T10:27:30.079+0000 7fc1d4d9f200 -1 osd.1 0 log_to_monitors {default=true} 2022-09-17T10:27:30.096 INFO:tasks.ceph.osd.6.smithi062.stderr:2022-09-17T10:27:30.094+0000 7f28ab385200 -1 osd.6 0 log_to_monitors {default=true} 2022-09-17T10:27:31.341 INFO:tasks.ceph.osd.10.smithi093.stderr:2022-09-17T10:27:31.340+0000 7f47ad94a700 -1 osd.10 0 waiting for initial osdmap 2022-09-17T10:27:31.342 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T10:27:31.339+0000 7ff582415700 -1 osd.5 0 waiting for initial osdmap 2022-09-17T10:27:31.345 INFO:tasks.ceph.osd.3.smithi062.stderr:2022-09-17T10:27:31.343+0000 7fdae948f700 -1 osd.3 0 waiting for initial osdmap 2022-09-17T10:27:31.345 INFO:tasks.ceph.osd.11.smithi159.stderr:2022-09-17T10:27:31.342+0000 7f226d83c700 -1 osd.11 0 waiting for initial osdmap 2022-09-17T10:27:31.346 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:27:31.342+0000 7f3caccef700 -1 osd.8 0 waiting for initial osdmap 2022-09-17T10:27:31.347 INFO:tasks.ceph.osd.1.smithi093.stderr:2022-09-17T10:27:31.343+0000 7fc1cb75e700 -1 osd.1 0 waiting for initial osdmap 2022-09-17T10:27:31.348 INFO:tasks.ceph.osd.0.smithi062.stderr:2022-09-17T10:27:31.345+0000 7f901f0c5700 -1 osd.0 0 waiting for initial osdmap 2022-09-17T10:27:31.349 INFO:tasks.ceph.osd.9.smithi062.stderr:2022-09-17T10:27:31.346+0000 7f65b3cdf700 -1 osd.9 0 waiting for initial osdmap 2022-09-17T10:27:31.350 INFO:tasks.ceph.osd.11.smithi159.stderr:2022-09-17T10:27:31.347+0000 7f2269fb8700 -1 osd.11 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.351 INFO:tasks.ceph.osd.4.smithi093.stderr:2022-09-17T10:27:31.346+0000 7f059a989700 -1 osd.4 0 waiting for initial osdmap 2022-09-17T10:27:31.352 INFO:tasks.ceph.osd.2.smithi159.stderr:2022-09-17T10:27:31.347+0000 7ff479949700 -1 osd.2 0 waiting for initial osdmap 2022-09-17T10:27:31.353 INFO:tasks.ceph.osd.7.smithi093.stderr:2022-09-17T10:27:31.349+0000 7f66aa07b700 -1 osd.7 0 waiting for initial osdmap 2022-09-17T10:27:31.354 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T10:27:31.348+0000 7ff57eb91700 -1 osd.5 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.355 INFO:tasks.ceph.osd.1.smithi093.stderr:2022-09-17T10:27:31.351+0000 7fc1c7eda700 -1 osd.1 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.356 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:27:31.348+0000 7f3ca946b700 -1 osd.8 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.356 INFO:tasks.ceph.osd.10.smithi093.stderr:2022-09-17T10:27:31.351+0000 7f47aa0c6700 -1 osd.10 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.357 INFO:tasks.ceph.osd.2.smithi159.stderr:2022-09-17T10:27:31.352+0000 7ff4760c5700 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.358 INFO:tasks.ceph.osd.4.smithi093.stderr:2022-09-17T10:27:31.352+0000 7f0597105700 -1 osd.4 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.359 INFO:tasks.ceph.osd.7.smithi093.stderr:2022-09-17T10:27:31.355+0000 7f66a67f7700 -1 osd.7 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.360 INFO:tasks.ceph.osd.6.smithi062.stderr:2022-09-17T10:27:31.350+0000 7f28a1d44700 -1 osd.6 0 waiting for initial osdmap 2022-09-17T10:27:31.360 INFO:tasks.ceph.osd.3.smithi062.stderr:2022-09-17T10:27:31.353+0000 7fdae5c0b700 -1 osd.3 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.361 INFO:tasks.ceph.osd.9.smithi062.stderr:2022-09-17T10:27:31.353+0000 7f65b045b700 -1 osd.9 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.361 INFO:tasks.ceph.osd.6.smithi062.stderr:2022-09-17T10:27:31.354+0000 7f289e4c0700 -1 osd.6 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:31.362 INFO:tasks.ceph.osd.0.smithi062.stderr:2022-09-17T10:27:31.354+0000 7f901b841700 -1 osd.0 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-17T10:27:34.819 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:34.940 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.938+0000 7f22b56a5700 1 Processor -- start 2022-09-17T10:27:34.940 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.938+0000 7f22b56a5700 1 -- start start 2022-09-17T10:27:34.943 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.939+0000 7f22b56a5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f22b017e220 0x7f22b017f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:34.944 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.939+0000 7f22b56a5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b00c9b70 con 0x7f22b00c8630 2022-09-17T10:27:34.944 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.939+0000 7f22b56a5700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b017e600 con 0x7f22b00c81b0 2022-09-17T10:27:34.944 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.939+0000 7f22b56a5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b00c8aa0 con 0x7f22b017e220 2022-09-17T10:27:34.945 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.939+0000 7f22aeffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f22b017e220 0x7f22b017f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:34.945 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.939+0000 7f22af7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f22b00c8630 0x7f22b00c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33216/0 (socket says 172.21.15.62:33216) 2022-09-17T10:27:34.945 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.939+0000 7f22af7fe700 1 -- 172.21.15.62:0/4165764015 learned_addr learned my addr 172.21.15.62:0/4165764015 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:34.946 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.940+0000 7f22aeffd700 1 -- 172.21.15.62:0/4165764015 >> v1:172.21.15.93:6789/0 conn(0x7f22b00c81b0 legacy=0x7f22b00ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:34.946 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.940+0000 7f22aeffd700 1 -- 172.21.15.62:0/4165764015 >> v1:172.21.15.62:6789/0 conn(0x7f22b00c8630 legacy=0x7f22b00c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:34.946 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.940+0000 7f22aeffd700 1 -- 172.21.15.62:0/4165764015 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00c8c80 con 0x7f22b017e220 2022-09-17T10:27:34.946 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.940+0000 7f22adffb700 1 -- 172.21.15.62:0/4165764015 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896431647 0 0) 0x7f22b00c9b70 con 0x7f22b00c8630 2022-09-17T10:27:34.947 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.940+0000 7f22aeffd700 1 --2- 172.21.15.62:0/4165764015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b017e220 0x7f22b017f190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f22a0009e60 tx=0x7f22a0009780).ready entity=mon.0 client_cookie=6de36924228b895e server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:34.947 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.940+0000 7f22adffb700 1 -- 172.21.15.62:0/4165764015 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000e070 con 0x7f22b017e220 2022-09-17T10:27:34.948 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.940+0000 7f22adffb700 1 -- 172.21.15.62:0/4165764015 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000bc30 con 0x7f22b017e220 2022-09-17T10:27:34.949 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.940+0000 7f22adffb700 1 -- 172.21.15.62:0/4165764015 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0012410 con 0x7f22b017e220 2022-09-17T10:27:34.949 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.941+0000 7f22b56a5700 1 -- 172.21.15.62:0/4165764015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b017e220 msgr2=0x7f22b017f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:34.949 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.941+0000 7f22b56a5700 1 --2- 172.21.15.62:0/4165764015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b017e220 0x7f22b017f190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f22a0009e60 tx=0x7f22a0009780).stop 2022-09-17T10:27:34.950 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.941+0000 7f22b56a5700 1 -- 172.21.15.62:0/4165764015 shutdown_connections 2022-09-17T10:27:34.950 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.941+0000 7f22b56a5700 1 --2- 172.21.15.62:0/4165764015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b017e220 0x7f22b017f190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:34.951 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.941+0000 7f22b56a5700 1 -- 172.21.15.62:0/4165764015 >> 172.21.15.62:0/4165764015 conn(0x7f22b00f4c90 msgr2=0x7f22b00f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:34.951 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.941+0000 7f22b56a5700 1 -- 172.21.15.62:0/4165764015 shutdown_connections 2022-09-17T10:27:34.951 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.941+0000 7f22b56a5700 1 -- 172.21.15.62:0/4165764015 wait complete. 2022-09-17T10:27:34.957 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.942+0000 7f22b56a5700 1 Processor -- start 2022-09-17T10:27:34.957 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.942+0000 7f22b56a5700 1 -- start start 2022-09-17T10:27:34.957 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.943+0000 7f22b56a5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b00c81b0 0x7f22b01927f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:34.957 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.943+0000 7f22b56a5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b00c8630 0x7f22b0192ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:34.958 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.943+0000 7f22b56a5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22b017e220 0x7f22b016ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:34.958 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.943+0000 7f22b56a5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00c47b0 con 0x7f22b00c8630 2022-09-17T10:27:34.958 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.943+0000 7f22b56a5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0193370 con 0x7f22b017e220 2022-09-17T10:27:34.959 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.943+0000 7f22b56a5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00c4a50 con 0x7f22b00c81b0 2022-09-17T10:27:34.959 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.943+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b00c8630 0x7f22b0192ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:34.959 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b00c8630 0x7f22b0192ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52500/0 (socket says 172.21.15.62:52500) 2022-09-17T10:27:34.959 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22ae7fc700 1 -- 172.21.15.62:0/1402017081 learned_addr learned my addr 172.21.15.62:0/1402017081 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:34.960 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22af7fe700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22b017e220 0x7f22b016ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:34.960 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22aeffd700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b00c81b0 0x7f22b01927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:34.960 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22ae7fc700 1 -- 172.21.15.62:0/1402017081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b00c81b0 msgr2=0x7f22b01927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:34.960 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22ae7fc700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b00c81b0 0x7f22b01927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:34.961 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22ae7fc700 1 -- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22b017e220 msgr2=0x7f22b016ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:34.961 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22ae7fc700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22b017e220 0x7f22b016ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:34.961 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22ae7fc700 1 -- 172.21.15.62:0/1402017081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0009a20 con 0x7f22b00c8630 2022-09-17T10:27:34.961 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22af7fe700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22b017e220 0x7f22b016ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:34.962 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22aeffd700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b00c81b0 0x7f22b01927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:34.962 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22ae7fc700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b00c8630 0x7f22b0192ce0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f229800c440 tx=0x7f2298007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:34.962 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22a6ffd700 1 -- 172.21.15.62:0/1402017081 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2298007020 con 0x7f22b00c8630 2022-09-17T10:27:34.962 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22a6ffd700 1 -- 172.21.15.62:0/1402017081 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2298007180 con 0x7f22b00c8630 2022-09-17T10:27:34.962 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b00c4d30 con 0x7f22b00c8630 2022-09-17T10:27:34.963 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22a6ffd700 1 -- 172.21.15.62:0/1402017081 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2298007520 con 0x7f22b00c8630 2022-09-17T10:27:34.963 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.944+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b0193650 con 0x7f22b00c8630 2022-09-17T10:27:34.963 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.945+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b0190620 con 0x7f22b00c8630 2022-09-17T10:27:34.963 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.946+0000 7f22a6ffd700 1 -- 172.21.15.62:0/1402017081 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2298010070 con 0x7f22b00c8630 2022-09-17T10:27:34.964 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.946+0000 7f22a6ffd700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f229408ba40 0x7f229408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:34.964 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.947+0000 7f22a6ffd700 1 -- 172.21.15.62:0/1402017081 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6756+0+0 (secure 0 0 0) 0x7f22980afb50 con 0x7f22b00c8630 2022-09-17T10:27:34.964 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.947+0000 7f22aeffd700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f229408ba40 0x7f229408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:34.964 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.947+0000 7f22aeffd700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f229408ba40 0x7f229408df00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f22a0009e60 tx=0x7f22a0009780).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:34.965 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:34.950+0000 7f22a6ffd700 1 -- 172.21.15.62:0/1402017081 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f2298081060 con 0x7f22b00c8630 2022-09-17T10:27:35.123 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.121+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22b016e7e0 con 0x7f22b00c8630 2022-09-17T10:27:35.124 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.122+0000 7f22a6ffd700 1 -- 172.21.15.62:0/1402017081 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16859 (secure 0 0 0) 0x7f2298020020 con 0x7f22b00c8630 2022-09-17T10:27:35.124 INFO:teuthology.misc.health.smithi062.stdout: 2022-09-17T10:27:35.125 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":19,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:34.355971+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:35.126 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f229408ba40 msgr2=0x7f229408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:35.127 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f229408ba40 0x7f229408df00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f22a0009e60 tx=0x7f22a0009780).stop 2022-09-17T10:27:35.127 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b00c8630 msgr2=0x7f22b0192ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:35.128 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b00c8630 0x7f22b0192ce0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f229800c440 tx=0x7f2298007e00).stop 2022-09-17T10:27:35.128 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 shutdown_connections 2022-09-17T10:27:35.129 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f229408ba40 0x7f229408df00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.130 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22b017e220 0x7f22b016ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.130 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22b00c81b0 0x7f22b01927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.130 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 --2- 172.21.15.62:0/1402017081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b00c8630 0x7f22b0192ce0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.131 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 >> 172.21.15.62:0/1402017081 conn(0x7f22b00f4c90 msgr2=0x7f22b0184170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:35.131 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 shutdown_connections 2022-09-17T10:27:35.131 INFO:teuthology.misc.health.smithi062.stderr:2022-09-17T10:27:35.124+0000 7f22b56a5700 1 -- 172.21.15.62:0/1402017081 wait complete. 2022-09-17T10:27:35.137 DEBUG:teuthology.misc:12 of 12 OSDs are up 2022-09-17T10:27:35.138 INFO:tasks.ceph:Creating RBD pool 2022-09-17T10:27:35.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2022-09-17T10:27:35.257 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.255+0000 7f0e7e86b700 1 Processor -- start 2022-09-17T10:27:35.258 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.255+0000 7f0e7e86b700 1 -- start start 2022-09-17T10:27:35.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e7e86b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e78175590 0x7f0e78180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:35.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e7e86b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0e780ef650 0x7f0e780efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:35.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e7e86b700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e780c6dd0 con 0x7f0e781751b0 2022-09-17T10:27:35.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e7e86b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e780f10e0 con 0x7f0e78175590 2022-09-17T10:27:35.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e7e86b700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e781801e0 con 0x7f0e780ef650 2022-09-17T10:27:35.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e777fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e78175590 0x7f0e78180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:35.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e777fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e78175590 0x7f0e78180d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52506/0 (socket says 172.21.15.62:52506) 2022-09-17T10:27:35.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e777fe700 1 -- 172.21.15.62:0/618537655 learned_addr learned my addr 172.21.15.62:0/618537655 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:35.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e7ce08700 1 --2- 172.21.15.62:0/618537655 >> v2:172.21.15.159:3300/0 conn(0x7f0e780ef650 0x7f0e780efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:35.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e777fe700 1 -- 172.21.15.62:0/618537655 >> v2:172.21.15.159:3300/0 conn(0x7f0e780ef650 msgr2=0x7f0e780efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:35.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e777fe700 1 --2- 172.21.15.62:0/618537655 >> v2:172.21.15.159:3300/0 conn(0x7f0e780ef650 0x7f0e780efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e777fe700 1 -- 172.21.15.62:0/618537655 >> v1:172.21.15.159:6789/0 conn(0x7f0e781751b0 legacy=0x7f0e78180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:35.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.256+0000 7f0e777fe700 1 -- 172.21.15.62:0/618537655 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780f0840 con 0x7f0e78175590 2022-09-17T10:27:35.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e777fe700 1 --2- 172.21.15.62:0/618537655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e78175590 0x7f0e78180d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f0e78088650 tx=0x7f0e6c0090f0).ready entity=mon.0 client_cookie=440bd003b6dd37e8 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:35.274 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e76ffd700 1 -- 172.21.15.62:0/618537655 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c00b520 con 0x7f0e78175590 2022-09-17T10:27:35.274 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e76ffd700 1 -- 172.21.15.62:0/618537655 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c00b680 con 0x7f0e78175590 2022-09-17T10:27:35.274 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e76ffd700 1 -- 172.21.15.62:0/618537655 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c00ba20 con 0x7f0e78175590 2022-09-17T10:27:35.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e7e86b700 1 -- 172.21.15.62:0/618537655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e78175590 msgr2=0x7f0e78180d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:35.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/618537655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e78175590 0x7f0e78180d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f0e78088650 tx=0x7f0e6c0090f0).stop 2022-09-17T10:27:35.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e7e86b700 1 -- 172.21.15.62:0/618537655 shutdown_connections 2022-09-17T10:27:35.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/618537655 >> v2:172.21.15.159:3300/0 conn(0x7f0e780ef650 0x7f0e780efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/618537655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e78175590 0x7f0e78180d80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e7e86b700 1 -- 172.21.15.62:0/618537655 >> 172.21.15.62:0/618537655 conn(0x7f0e7806a170 msgr2=0x7f0e780f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:35.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e7e86b700 1 -- 172.21.15.62:0/618537655 shutdown_connections 2022-09-17T10:27:35.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.257+0000 7f0e7e86b700 1 -- 172.21.15.62:0/618537655 wait complete. 2022-09-17T10:27:35.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.259+0000 7f0e7e86b700 1 Processor -- start 2022-09-17T10:27:35.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.259+0000 7f0e7e86b700 1 -- start start 2022-09-17T10:27:35.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e7e86b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780ef650 0x7f0e7817dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:35.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e7e86b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e781751b0 0x7f0e7818f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:35.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e7e86b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e78175590 0x7f0e78085820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:35.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e7e86b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7817c8b0 con 0x7f0e780ef650 2022-09-17T10:27:35.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e7e86b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7817cb90 con 0x7f0e78175590 2022-09-17T10:27:35.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e7e86b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7817ce70 con 0x7f0e781751b0 2022-09-17T10:27:35.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780ef650 0x7f0e7817dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:35.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780ef650 0x7f0e7817dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52510/0 (socket says 172.21.15.62:52510) 2022-09-17T10:27:35.279 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 -- 172.21.15.62:0/586619782 learned_addr learned my addr 172.21.15.62:0/586619782 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:35.279 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e777fe700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e781751b0 0x7f0e7818f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:35.280 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e7ce08700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e78175590 0x7f0e78085820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:35.280 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 -- 172.21.15.62:0/586619782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e781751b0 msgr2=0x7f0e7818f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:35.281 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e781751b0 0x7f0e7818f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.281 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 -- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e78175590 msgr2=0x7f0e78085820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:35.282 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e78175590 0x7f0e78085820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:35.282 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 -- 172.21.15.62:0/586619782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c009370 con 0x7f0e780ef650 2022-09-17T10:27:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.260+0000 7f0e77fff700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780ef650 0x7f0e7817dc30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0e6800c440 tx=0x7f0e68007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.261+0000 7f0e5ffff700 1 -- 172.21.15.62:0/586619782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68012400 con 0x7f0e780ef650 2022-09-17T10:27:35.283 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.261+0000 7f0e5ffff700 1 -- 172.21.15.62:0/586619782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e68012580 con 0x7f0e780ef650 2022-09-17T10:27:35.284 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.261+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7817d150 con 0x7f0e780ef650 2022-09-17T10:27:35.284 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.261+0000 7f0e5ffff700 1 -- 172.21.15.62:0/586619782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68012940 con 0x7f0e780ef650 2022-09-17T10:27:35.285 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.261+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7817d710 con 0x7f0e780ef650 2022-09-17T10:27:35.285 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.261+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7817da80 con 0x7f0e780ef650 2022-09-17T10:27:35.285 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.262+0000 7f0e5ffff700 1 -- 172.21.15.62:0/586619782 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f0e68019030 con 0x7f0e780ef650 2022-09-17T10:27:35.286 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.263+0000 7f0e5ffff700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0e5808ba40 0x7f0e5808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:35.286 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.263+0000 7f0e5ffff700 1 -- 172.21.15.62:0/586619782 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6756+0+0 (secure 0 0 0) 0x7f0e680af220 con 0x7f0e780ef650 2022-09-17T10:27:35.287 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.263+0000 7f0e777fe700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0e5808ba40 0x7f0e5808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:35.287 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.264+0000 7f0e777fe700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0e5808ba40 0x7f0e5808df00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0e6c00b2e0 tx=0x7f0e6c017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:35.288 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.267+0000 7f0e5ffff700 1 -- 172.21.15.62:0/586619782 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f0e68080730 con 0x7f0e780ef650 2022-09-17T10:27:35.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:35.442+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f0e7806bf40 con 0x7f0e780ef650 2022-09-17T10:27:36.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.378+0000 7f0e5ffff700 1 -- 172.21.15.62:0/586619782 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v21) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0e68017070 con 0x7f0e780ef650 2022-09-17T10:27:36.384 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0e5808ba40 msgr2=0x7f0e5808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:36.384 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0e5808ba40 0x7f0e5808df00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0e6c00b2e0 tx=0x7f0e6c017000).stop 2022-09-17T10:27:36.384 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780ef650 msgr2=0x7f0e7817dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:36.385 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780ef650 0x7f0e7817dc30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0e6800c440 tx=0x7f0e68007dc0).stop 2022-09-17T10:27:36.385 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 shutdown_connections 2022-09-17T10:27:36.386 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0e5808ba40 0x7f0e5808df00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:36.387 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e78175590 0x7f0e78085820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:36.387 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e780ef650 0x7f0e7817dc30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:36.387 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 --2- 172.21.15.62:0/586619782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e781751b0 0x7f0e7818f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:36.387 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.381+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 >> 172.21.15.62:0/586619782 conn(0x7f0e7806a170 msgr2=0x7f0e780efa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:36.388 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.382+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 shutdown_connections 2022-09-17T10:27:36.388 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.382+0000 7f0e7e86b700 1 -- 172.21.15.62:0/586619782 wait complete. 2022-09-17T10:27:36.388 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2022-09-17T10:27:36.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-09-17T10:27:36.526 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.524+0000 7f2bd9bc8700 1 Processor -- start 2022-09-17T10:27:36.526 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.524+0000 7f2bd9bc8700 1 -- start start 2022-09-17T10:27:36.533 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd9bc8700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2bd41751b0 0x7f2bd4180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:36.534 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd9bc8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd40c6dd0 con 0x7f2bd4175590 2022-09-17T10:27:36.534 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd9bc8700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd41801e0 con 0x7f2bd40ef650 2022-09-17T10:27:36.534 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd9bc8700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd40f10e0 con 0x7f2bd41751b0 2022-09-17T10:27:36.535 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd2ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2bd4175590 0x7f2bd4180b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33226/0 (socket says 172.21.15.62:33226) 2022-09-17T10:27:36.535 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd2ffd700 1 -- 172.21.15.62:0/2316456950 learned_addr learned my addr 172.21.15.62:0/2316456950 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:36.535 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd37fe700 1 --2- 172.21.15.62:0/2316456950 >> v2:172.21.15.93:3300/0 conn(0x7f2bd41751b0 0x7f2bd4180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:36.535 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd27fc700 1 -- 172.21.15.62:0/2316456950 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416696046 0 0) 0x7f2bd40c6dd0 con 0x7f2bd4175590 2022-09-17T10:27:36.535 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.525+0000 7f2bd27fc700 1 -- 172.21.15.62:0/2316456950 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc00033f0 con 0x7f2bd4175590 2022-09-17T10:27:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd37fe700 1 -- 172.21.15.62:0/2316456950 >> v1:172.21.15.93:6789/0 conn(0x7f2bd40ef650 legacy=0x7f2bd40efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd37fe700 1 -- 172.21.15.62:0/2316456950 >> v1:172.21.15.62:6789/0 conn(0x7f2bd4175590 legacy=0x7f2bd4180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd27fc700 1 -- 172.21.15.62:0/2316456950 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809252247 0 0) 0x7f2bc00033f0 con 0x7f2bd4175590 2022-09-17T10:27:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd37fe700 1 -- 172.21.15.62:0/2316456950 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd40f0840 con 0x7f2bd41751b0 2022-09-17T10:27:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd37fe700 1 --2- 172.21.15.62:0/2316456950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd41751b0 0x7f2bd4180670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2bc4009760 tx=0x7f2bc4009060).ready entity=mon.1 client_cookie=3097897997279ec3 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd27fc700 1 -- 172.21.15.62:0/2316456950 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8001470 con 0x7f2bd41751b0 2022-09-17T10:27:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd27fc700 1 -- 172.21.15.62:0/2316456950 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc4009130 con 0x7f2bd41751b0 2022-09-17T10:27:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd27fc700 1 -- 172.21.15.62:0/2316456950 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4011610 con 0x7f2bd41751b0 2022-09-17T10:27:36.538 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/2316456950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd41751b0 msgr2=0x7f2bd4180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:36.538 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd9bc8700 1 --2- 172.21.15.62:0/2316456950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd41751b0 0x7f2bd4180670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2bc4009760 tx=0x7f2bc4009060).stop 2022-09-17T10:27:36.539 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/2316456950 shutdown_connections 2022-09-17T10:27:36.539 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd9bc8700 1 --2- 172.21.15.62:0/2316456950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd41751b0 0x7f2bd4180670 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:36.540 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/2316456950 >> 172.21.15.62:0/2316456950 conn(0x7f2bd406a170 msgr2=0x7f2bd40f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:36.540 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/2316456950 shutdown_connections 2022-09-17T10:27:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.526+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/2316456950 wait complete. 2022-09-17T10:27:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.528+0000 7f2bd9bc8700 1 Processor -- start 2022-09-17T10:27:36.541 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.528+0000 7f2bd9bc8700 1 -- start start 2022-09-17T10:27:36.542 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd9bc8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bd40ef650 0x7f2bd40c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:36.542 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd9bc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd41751b0 0x7f2bd4085820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:36.543 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd9bc8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd4175590 0x7f2bd418fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd9bc8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4086e70 con 0x7f2bd41751b0 2022-09-17T10:27:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd9bc8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4085d10 con 0x7f2bd4175590 2022-09-17T10:27:36.544 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd9bc8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4085f80 con 0x7f2bd40ef650 2022-09-17T10:27:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd41751b0 0x7f2bd4085820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:36.545 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd41751b0 0x7f2bd4085820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52524/0 (socket says 172.21.15.62:52524) 2022-09-17T10:27:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 -- 172.21.15.62:0/228382197 learned_addr learned my addr 172.21.15.62:0/228382197 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd3fff700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd4175590 0x7f2bd418fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 -- 172.21.15.62:0/228382197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bd40ef650 msgr2=0x7f2bd40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd37fe700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bd40ef650 0x7f2bd40c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bd40ef650 0x7f2bd40c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 -- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd4175590 msgr2=0x7f2bd418fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd4175590 0x7f2bd418fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 -- 172.21.15.62:0/228382197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40092a0 con 0x7f2bd41751b0 2022-09-17T10:27:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd3fff700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd4175590 0x7f2bd418fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.529+0000 7f2bd2ffd700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd41751b0 0x7f2bd4085820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2bc800c810 tx=0x7f2bc8001a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.530+0000 7f2bbb7fe700 1 -- 172.21.15.62:0/228382197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8007170 con 0x7f2bd41751b0 2022-09-17T10:27:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.530+0000 7f2bbb7fe700 1 -- 172.21.15.62:0/228382197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc80072f0 con 0x7f2bd41751b0 2022-09-17T10:27:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.530+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd4086260 con 0x7f2bd41751b0 2022-09-17T10:27:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.530+0000 7f2bbb7fe700 1 -- 172.21.15.62:0/228382197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80048c0 con 0x7f2bd41751b0 2022-09-17T10:27:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.530+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd4086820 con 0x7f2bd41751b0 2022-09-17T10:27:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.531+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd4087020 con 0x7f2bd41751b0 2022-09-17T10:27:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.532+0000 7f2bbb7fe700 1 -- 172.21.15.62:0/228382197 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2bc801b060 con 0x7f2bd41751b0 2022-09-17T10:27:36.552 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.532+0000 7f2bbb7fe700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2bb408ba40 0x7f2bb408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:36.552 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.532+0000 7f2bbb7fe700 1 -- 172.21.15.62:0/228382197 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7098+0+0 (secure 0 0 0) 0x7f2bc80b01e0 con 0x7f2bd41751b0 2022-09-17T10:27:36.552 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.533+0000 7f2bd37fe700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2bb408ba40 0x7f2bb408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:36.552 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.533+0000 7f2bd37fe700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2bb408ba40 0x7f2bb408df00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2bc4009760 tx=0x7f2bc4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.536+0000 7f2bbb7fe700 1 -- 172.21.15.62:0/228382197 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f2bc80815a0 con 0x7f2bd41751b0 2022-09-17T10:27:36.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:36.710+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2bd4087200 con 0x7f2bd41751b0 2022-09-17T10:27:37.390 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.387+0000 7f2bbb7fe700 1 -- 172.21.15.62:0/228382197 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v22) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2bd4087200 con 0x7f2bd41751b0 2022-09-17T10:27:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2bb408ba40 msgr2=0x7f2bb408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.393 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2bb408ba40 0x7f2bb408df00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2bc4009760 tx=0x7f2bc4014000).stop 2022-09-17T10:27:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd41751b0 msgr2=0x7f2bd4085820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.394 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd41751b0 0x7f2bd4085820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2bc800c810 tx=0x7f2bc8001a30).stop 2022-09-17T10:27:37.396 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 shutdown_connections 2022-09-17T10:27:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2bb408ba40 0x7f2bb408df00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.397 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bd4175590 0x7f2bd418fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bd40ef650 0x7f2bd40c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 --2- 172.21.15.62:0/228382197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd41751b0 0x7f2bd4085820 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 >> 172.21.15.62:0/228382197 conn(0x7f2bd406a170 msgr2=0x7f2bd40f0040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 shutdown_connections 2022-09-17T10:27:37.399 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.391+0000 7f2bd9bc8700 1 -- 172.21.15.62:0/228382197 wait complete. 2022-09-17T10:27:37.400 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rbd' on pool 'rbd' 2022-09-17T10:27:37.408 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-09-17T10:27:37.408 INFO:tasks.ceph.mds.a:Restarting daemon 2022-09-17T10:27:37.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-09-17T10:27:37.412 INFO:tasks.ceph.mds.a:Started 2022-09-17T10:27:37.413 INFO:tasks.ceph.mds.d:Restarting daemon 2022-09-17T10:27:37.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-09-17T10:27:37.417 INFO:tasks.ceph.mds.d:Started 2022-09-17T10:27:37.418 INFO:tasks.ceph.mds.g:Restarting daemon 2022-09-17T10:27:37.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i g 2022-09-17T10:27:37.422 INFO:tasks.ceph.mds.g:Started 2022-09-17T10:27:37.423 INFO:tasks.ceph.mds.j:Restarting daemon 2022-09-17T10:27:37.424 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i j 2022-09-17T10:27:37.427 INFO:tasks.ceph.mds.j:Started 2022-09-17T10:27:37.428 INFO:tasks.ceph.mds.b:Restarting daemon 2022-09-17T10:27:37.428 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-09-17T10:27:37.432 INFO:tasks.ceph.mds.b:Started 2022-09-17T10:27:37.433 INFO:tasks.ceph.mds.e:Restarting daemon 2022-09-17T10:27:37.435 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2022-09-17T10:27:37.438 INFO:tasks.ceph.mds.e:Started 2022-09-17T10:27:37.438 INFO:tasks.ceph.mds.h:Restarting daemon 2022-09-17T10:27:37.439 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i h 2022-09-17T10:27:37.442 INFO:tasks.ceph.mds.h:Started 2022-09-17T10:27:37.443 INFO:tasks.ceph.mds.k:Restarting daemon 2022-09-17T10:27:37.443 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i k 2022-09-17T10:27:37.447 INFO:tasks.ceph.mds.k:Started 2022-09-17T10:27:37.448 INFO:tasks.ceph.mds.c:Restarting daemon 2022-09-17T10:27:37.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-09-17T10:27:37.452 INFO:tasks.ceph.mds.c:Started 2022-09-17T10:27:37.453 INFO:tasks.ceph.mds.f:Restarting daemon 2022-09-17T10:27:37.454 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2022-09-17T10:27:37.457 INFO:tasks.ceph.mds.f:Started 2022-09-17T10:27:37.457 INFO:tasks.ceph.mds.i:Restarting daemon 2022-09-17T10:27:37.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i i 2022-09-17T10:27:37.461 INFO:tasks.ceph.mds.i:Started 2022-09-17T10:27:37.462 INFO:tasks.ceph.mds.l:Restarting daemon 2022-09-17T10:27:37.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i l 2022-09-17T10:27:37.466 INFO:tasks.ceph.mds.l:Started 2022-09-17T10:27:37.467 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-09-17T10:27:37.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:37.502 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2022-09-17T10:27:37.504 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2022-09-17T10:27:37.509 INFO:tasks.ceph.mds.g.smithi062.stdout:starting mds.g at 2022-09-17T10:27:37.517 INFO:tasks.ceph.mds.j.smithi062.stdout:starting mds.j at 2022-09-17T10:27:37.521 INFO:tasks.ceph.mds.b.smithi093.stdout:starting mds.b at 2022-09-17T10:27:37.526 INFO:tasks.ceph.mds.e.smithi093.stdout:starting mds.e at 2022-09-17T10:27:37.530 INFO:tasks.ceph.mds.h.smithi093.stdout:starting mds.h at 2022-09-17T10:27:37.534 INFO:tasks.ceph.mds.k.smithi093.stdout:starting mds.k at 2022-09-17T10:27:37.546 INFO:tasks.ceph.mds.c.smithi159.stdout:starting mds.c at 2022-09-17T10:27:37.554 INFO:tasks.ceph.mds.i.smithi159.stdout:starting mds.i at 2022-09-17T10:27:37.554 INFO:tasks.ceph.mds.f.smithi159.stdout:starting mds.f at 2022-09-17T10:27:37.558 INFO:tasks.ceph.mds.l.smithi159.stdout:starting mds.l at 2022-09-17T10:27:37.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.610+0000 7f84da659700 1 Processor -- start 2022-09-17T10:27:37.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.610+0000 7f84da659700 1 -- start start 2022-09-17T10:27:37.627 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84da659700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84d41751b0 0x7f84d4180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84da659700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f84d4175590 0x7f84d4180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84da659700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40c6dd0 con 0x7f84d4181050 2022-09-17T10:27:37.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84da659700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d40f10e0 con 0x7f84d41751b0 2022-09-17T10:27:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84da659700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d40f0660 con 0x7f84d4175590 2022-09-17T10:27:37.629 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84d3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84d41751b0 0x7f84d4180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84d3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84d41751b0 0x7f84d4180670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52600/0 (socket says 172.21.15.62:52600) 2022-09-17T10:27:37.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84d3fff700 1 -- 172.21.15.62:0/3231680175 learned_addr learned my addr 172.21.15.62:0/3231680175 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.611+0000 7f84d37fe700 1 --2- 172.21.15.62:0/3231680175 >> v2:172.21.15.159:3300/0 conn(0x7f84d4175590 0x7f84d4180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84d3fff700 1 -- 172.21.15.62:0/3231680175 >> v2:172.21.15.159:3300/0 conn(0x7f84d4175590 msgr2=0x7f84d4180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:37.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84d3fff700 1 --2- 172.21.15.62:0/3231680175 >> v2:172.21.15.159:3300/0 conn(0x7f84d4175590 0x7f84d4180b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84d3fff700 1 -- 172.21.15.62:0/3231680175 >> v1:172.21.15.93:6789/0 conn(0x7f84d4181050 legacy=0x7f84d4181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84d3fff700 1 -- 172.21.15.62:0/3231680175 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d41801e0 con 0x7f84d41751b0 2022-09-17T10:27:37.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84d3fff700 1 --2- 172.21.15.62:0/3231680175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d41751b0 0x7f84d4180670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f84d4085780 tx=0x7f84c80090f0).ready entity=mon.0 client_cookie=948054a9186d57b8 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:37.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84d2ffd700 1 -- 172.21.15.62:0/3231680175 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800b600 con 0x7f84d41751b0 2022-09-17T10:27:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84d2ffd700 1 -- 172.21.15.62:0/3231680175 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c800b760 con 0x7f84d41751b0 2022-09-17T10:27:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84d2ffd700 1 -- 172.21.15.62:0/3231680175 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800bb00 con 0x7f84d41751b0 2022-09-17T10:27:37.635 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84da659700 1 -- 172.21.15.62:0/3231680175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d41751b0 msgr2=0x7f84d4180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.635 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84da659700 1 --2- 172.21.15.62:0/3231680175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d41751b0 0x7f84d4180670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f84d4085780 tx=0x7f84c80090f0).stop 2022-09-17T10:27:37.636 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84da659700 1 -- 172.21.15.62:0/3231680175 shutdown_connections 2022-09-17T10:27:37.636 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84da659700 1 --2- 172.21.15.62:0/3231680175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d41751b0 0x7f84d4180670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.636 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84da659700 1 --2- 172.21.15.62:0/3231680175 >> v2:172.21.15.159:3300/0 conn(0x7f84d4175590 0x7f84d4180b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.637 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84da659700 1 -- 172.21.15.62:0/3231680175 >> 172.21.15.62:0/3231680175 conn(0x7f84d406a170 msgr2=0x7f84d40f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:37.637 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84da659700 1 -- 172.21.15.62:0/3231680175 shutdown_connections 2022-09-17T10:27:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.612+0000 7f84da659700 1 -- 172.21.15.62:0/3231680175 wait complete. 2022-09-17T10:27:37.638 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.614+0000 7f84da659700 1 Processor -- start 2022-09-17T10:27:37.639 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.614+0000 7f84da659700 1 -- start start 2022-09-17T10:27:37.639 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84da659700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84d41751b0 0x7f84d4164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.639 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84da659700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d4175590 0x7f84d4087320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.640 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84da659700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d4181050 0x7f84d40cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.640 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84da659700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4087c60 con 0x7f84d4181050 2022-09-17T10:27:37.641 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84da659700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4087f40 con 0x7f84d41751b0 2022-09-17T10:27:37.641 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84da659700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4088220 con 0x7f84d4175590 2022-09-17T10:27:37.642 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d8bf6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d4181050 0x7f84d40cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.642 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d8bf6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d4181050 0x7f84d40cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52604/0 (socket says 172.21.15.62:52604) 2022-09-17T10:27:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d8bf6700 1 -- 172.21.15.62:0/1134078666 learned_addr learned my addr 172.21.15.62:0/1134078666 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:37.643 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d3fff700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84d41751b0 0x7f84d4164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d37fe700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d4175590 0x7f84d4087320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d8bf6700 1 -- 172.21.15.62:0/1134078666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d4175590 msgr2=0x7f84d4087320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.644 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d8bf6700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d4175590 0x7f84d4087320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d8bf6700 1 -- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84d41751b0 msgr2=0x7f84d4164ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d8bf6700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84d41751b0 0x7f84d4164ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.646 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.615+0000 7f84d8bf6700 1 -- 172.21.15.62:0/1134078666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8009370 con 0x7f84d4181050 2022-09-17T10:27:37.646 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.616+0000 7f84d8bf6700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d4181050 0x7f84d40cb060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f84cc00c7c0 tx=0x7f84cc0014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.616+0000 7f84bbfff700 1 -- 172.21.15.62:0/1134078666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc010510 con 0x7f84d4181050 2022-09-17T10:27:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.616+0000 7f84bbfff700 1 -- 172.21.15.62:0/1134078666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc010670 con 0x7f84d4181050 2022-09-17T10:27:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.616+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d40ca860 con 0x7f84d4181050 2022-09-17T10:27:37.648 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.616+0000 7f84bbfff700 1 -- 172.21.15.62:0/1134078666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0109f0 con 0x7f84d4181050 2022-09-17T10:27:37.649 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.616+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d4165390 con 0x7f84d4181050 2022-09-17T10:27:37.649 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.617+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d40ca6c0 con 0x7f84d4181050 2022-09-17T10:27:37.649 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.618+0000 7f84bbfff700 1 -- 172.21.15.62:0/1134078666 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f84cc019030 con 0x7f84d4181050 2022-09-17T10:27:37.650 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.618+0000 7f84bbfff700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f84b408ba40 0x7f84b408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.650 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.618+0000 7f84bbfff700 1 -- 172.21.15.62:0/1134078666 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f84cc0afa00 con 0x7f84d4181050 2022-09-17T10:27:37.651 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.618+0000 7f84d3fff700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f84b408ba40 0x7f84b408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.651 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.619+0000 7f84d3fff700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f84b408ba40 0x7f84b408df00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f84c8009fd0 tx=0x7f84c8017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:37.652 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.622+0000 7f84bbfff700 1 -- 172.21.15.62:0/1134078666 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f84d40ca6c0 con 0x7f84d4181050 2022-09-17T10:27:37.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.793+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84d40ca6c0 con 0x7f84d4181050 2022-09-17T10:27:37.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.794+0000 7f84bbfff700 1 -- 172.21.15.62:0/1134078666 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18379 (secure 0 0 0) 0x7f84d40ca6c0 con 0x7f84d4181050 2022-09-17T10:27:37.797 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:37.798 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:37.377539+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:37.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f84b408ba40 msgr2=0x7f84b408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f84b408ba40 0x7f84b408df00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f84c8009fd0 tx=0x7f84c8017000).stop 2022-09-17T10:27:37.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d4181050 msgr2=0x7f84d40cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d4181050 0x7f84d40cb060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f84cc00c7c0 tx=0x7f84cc0014e0).stop 2022-09-17T10:27:37.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 shutdown_connections 2022-09-17T10:27:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f84b408ba40 0x7f84b408df00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84d41751b0 0x7f84d4164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84d4181050 0x7f84d40cb060 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 --2- 172.21.15.62:0/1134078666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84d4175590 0x7f84d4087320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 >> 172.21.15.62:0/1134078666 conn(0x7f84d406a170 msgr2=0x7f84d4180670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 shutdown_connections 2022-09-17T10:27:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.796+0000 7f84da659700 1 -- 172.21.15.62:0/1134078666 wait complete. 2022-09-17T10:27:37.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-09-17T10:27:32.392964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-09-17T10:27:35.474566+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-09-17T10:27:37.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-09-17T10:27:37.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.971+0000 7fb85ab83700 1 Processor -- start 2022-09-17T10:27:37.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.971+0000 7fb85ab83700 1 -- start start 2022-09-17T10:27:37.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb85ab83700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8540f0000 0x7fb854063350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb85ab83700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb854063840 0x7fb854063cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb85ab83700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb854062ec0 con 0x7fb8541785e0 2022-09-17T10:27:37.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb85ab83700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85417e1c0 con 0x7fb8540f0000 2022-09-17T10:27:37.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb85ab83700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb854062010 con 0x7fb854063840 2022-09-17T10:27:37.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb853fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8540f0000 0x7fb854063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb853fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8540f0000 0x7fb854063350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52614/0 (socket says 172.21.15.62:52614) 2022-09-17T10:27:37.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb853fff700 1 -- 172.21.15.62:0/3896377668 learned_addr learned my addr 172.21.15.62:0/3896377668 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:37.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb85891f700 1 --1- 172.21.15.62:0/3896377668 >> v1:172.21.15.62:6789/0 conn(0x7fb8541785e0 0x7fb8540ef8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33246/0 (socket says 172.21.15.62:33246) 2022-09-17T10:27:37.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb859120700 1 --2- 172.21.15.62:0/3896377668 >> v2:172.21.15.93:3300/0 conn(0x7fb854063840 0x7fb854063cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb853fff700 1 -- 172.21.15.62:0/3896377668 >> v2:172.21.15.93:3300/0 conn(0x7fb854063840 msgr2=0x7fb854063cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:37.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb853fff700 1 --2- 172.21.15.62:0/3896377668 >> v2:172.21.15.93:3300/0 conn(0x7fb854063840 0x7fb854063cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb853fff700 1 -- 172.21.15.62:0/3896377668 >> v1:172.21.15.62:6789/0 conn(0x7fb8541785e0 legacy=0x7fb8540ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb853fff700 1 -- 172.21.15.62:0/3896377668 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540622b0 con 0x7fb8540f0000 2022-09-17T10:27:37.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb8537fe700 1 -- 172.21.15.62:0/3896377668 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438363427 0 0) 0x7fb854062ec0 con 0x7fb8541785e0 2022-09-17T10:27:37.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb859120700 1 --2- 172.21.15.62:0/3896377668 >> v2:172.21.15.93:3300/0 conn(0x7fb854063840 0x7fb854063cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:37.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb853fff700 1 --2- 172.21.15.62:0/3896377668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8540f0000 0x7fb854063350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb85417f410 tx=0x7fb8480090f0).ready entity=mon.0 client_cookie=28ef3bb6c0b6538a server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:37.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb8537fe700 1 -- 172.21.15.62:0/3896377668 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800b600 con 0x7fb8540f0000 2022-09-17T10:27:37.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb8537fe700 1 -- 172.21.15.62:0/3896377668 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800b760 con 0x7fb8540f0000 2022-09-17T10:27:37.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.973+0000 7fb8537fe700 1 -- 172.21.15.62:0/3896377668 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800bae0 con 0x7fb8540f0000 2022-09-17T10:27:37.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.974+0000 7fb85ab83700 1 -- 172.21.15.62:0/3896377668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8540f0000 msgr2=0x7fb854063350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.974+0000 7fb85ab83700 1 --2- 172.21.15.62:0/3896377668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8540f0000 0x7fb854063350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb85417f410 tx=0x7fb8480090f0).stop 2022-09-17T10:27:37.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.974+0000 7fb85ab83700 1 -- 172.21.15.62:0/3896377668 shutdown_connections 2022-09-17T10:27:37.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.974+0000 7fb85ab83700 1 --2- 172.21.15.62:0/3896377668 >> v2:172.21.15.93:3300/0 conn(0x7fb854063840 0x7fb854063cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.974+0000 7fb85ab83700 1 --2- 172.21.15.62:0/3896377668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8540f0000 0x7fb854063350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.974+0000 7fb85ab83700 1 -- 172.21.15.62:0/3896377668 >> 172.21.15.62:0/3896377668 conn(0x7fb85406a170 msgr2=0x7fb8540f4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:37.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.974+0000 7fb85ab83700 1 -- 172.21.15.62:0/3896377668 shutdown_connections 2022-09-17T10:27:37.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.974+0000 7fb85ab83700 1 -- 172.21.15.62:0/3896377668 wait complete. 2022-09-17T10:27:37.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.975+0000 7fb85ab83700 1 Processor -- start 2022-09-17T10:27:37.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.976+0000 7fb85ab83700 1 -- start start 2022-09-17T10:27:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.976+0000 7fb85ab83700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb854063840 0x7fb8540ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85ab83700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8540f0000 0x7fb8540ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85ab83700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8541785e0 0x7fb854152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85ab83700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540ed640 con 0x7fb854063840 2022-09-17T10:27:37.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85ab83700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540ec470 con 0x7fb8541785e0 2022-09-17T10:27:37.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85ab83700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540ec750 con 0x7fb8540f0000 2022-09-17T10:27:37.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb854063840 0x7fb8540ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb854063840 0x7fb8540ebc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52630/0 (socket says 172.21.15.62:52630) 2022-09-17T10:27:37.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 -- 172.21.15.62:0/1908237602 learned_addr learned my addr 172.21.15.62:0/1908237602 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:37.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb853fff700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8540f0000 0x7fb8540ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb859120700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8541785e0 0x7fb854152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 -- 172.21.15.62:0/1908237602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8540f0000 msgr2=0x7fb8540ee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8540f0000 0x7fb8540ee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 -- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8541785e0 msgr2=0x7fb854152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:37.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8541785e0 0x7fb854152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:37.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 -- 172.21.15.62:0/1908237602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009370 con 0x7fb854063840 2022-09-17T10:27:37.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb859120700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8541785e0 0x7fb854152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:37.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85891f700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb854063840 0x7fb8540ebc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb84c001560 tx=0x7fb84c0016c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:37.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb850ff9700 1 -- 172.21.15.62:0/1908237602 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c001750 con 0x7fb854063840 2022-09-17T10:27:37.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb850ff9700 1 -- 172.21.15.62:0/1908237602 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c005c70 con 0x7fb854063840 2022-09-17T10:27:37.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8540eca30 con 0x7fb854063840 2022-09-17T10:27:37.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb850ff9700 1 -- 172.21.15.62:0/1908237602 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c007110 con 0x7fb854063840 2022-09-17T10:27:37.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.977+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8540ecff0 con 0x7fb854063840 2022-09-17T10:27:37.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.978+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85406bf40 con 0x7fb854063840 2022-09-17T10:27:37.994 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.979+0000 7fb850ff9700 1 -- 172.21.15.62:0/1908237602 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb84c010030 con 0x7fb854063840 2022-09-17T10:27:37.994 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.980+0000 7fb850ff9700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb83408ba40 0x7fb83408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:37.994 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.980+0000 7fb850ff9700 1 -- 172.21.15.62:0/1908237602 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fb84c0b08e0 con 0x7fb854063840 2022-09-17T10:27:37.994 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.980+0000 7fb853fff700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb83408ba40 0x7fb83408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:37.995 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.981+0000 7fb853fff700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb83408ba40 0x7fb83408df00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb848009130 tx=0x7fb848017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:37.995 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:37.983+0000 7fb850ff9700 1 -- 172.21.15.62:0/1908237602 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fb84c081b80 con 0x7fb854063840 2022-09-17T10:27:38.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.155+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb854062590 con 0x7fb854063840 2022-09-17T10:27:38.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.155+0000 7fb850ff9700 1 -- 172.21.15.62:0/1908237602 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb84c0851a0 con 0x7fb854063840 2022-09-17T10:27:38.158 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2022-09-17T10:27:38.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb83408ba40 msgr2=0x7fb83408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb83408ba40 0x7fb83408df00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb848009130 tx=0x7fb848017000).stop 2022-09-17T10:27:38.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb854063840 msgr2=0x7fb8540ebc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.161 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb854063840 0x7fb8540ebc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb84c001560 tx=0x7fb84c0016c0).stop 2022-09-17T10:27:38.161 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 shutdown_connections 2022-09-17T10:27:38.161 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb83408ba40 0x7fb83408df00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.161 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8541785e0 0x7fb854152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.162 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb854063840 0x7fb8540ebc60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.162 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 --2- 172.21.15.62:0/1908237602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8540f0000 0x7fb8540ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.162 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 >> 172.21.15.62:0/1908237602 conn(0x7fb85406a170 msgr2=0x7fb8540f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:38.163 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 shutdown_connections 2022-09-17T10:27:38.163 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.157+0000 7fb85ab83700 1 -- 172.21.15.62:0/1908237602 wait complete. 2022-09-17T10:27:38.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-17T10:27:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.290+0000 7f98452f3700 1 Processor -- start 2022-09-17T10:27:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.290+0000 7f98452f3700 1 -- start start 2022-09-17T10:27:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.291+0000 7f98452f3700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f984017de70 0x7f98400b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.291+0000 7f98452f3700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98400b7730 con 0x7f984017da90 2022-09-17T10:27:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.291+0000 7f98452f3700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98400ec220 con 0x7f98400e5440 2022-09-17T10:27:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.291+0000 7f98452f3700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98400ec500 con 0x7f984017de70 2022-09-17T10:27:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f9844af2700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f984017de70 0x7f98400b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f9844af2700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f984017de70 0x7f98400b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.62:36678/0 (socket says 172.21.15.62:36678) 2022-09-17T10:27:38.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f9844af2700 1 -- 172.21.15.62:0/1937767390 learned_addr learned my addr 172.21.15.62:0/1937767390 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f983ffff700 1 --1- 172.21.15.62:0/1937767390 >> v1:172.21.15.93:6789/0 conn(0x7f984017da90 0x7f98400e4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.62:55080/0 (socket says 172.21.15.62:55080) 2022-09-17T10:27:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f983f7fe700 1 --1- 172.21.15.62:0/1937767390 >> v1:172.21.15.159:6789/0 conn(0x7f98400e5440 0x7f98400b7bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.62:54708/0 (socket says 172.21.15.62:54708) 2022-09-17T10:27:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f983effd700 1 -- 172.21.15.62:0/1937767390 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606261659 0 0) 0x7f98400b7730 con 0x7f984017da90 2022-09-17T10:27:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f983effd700 1 -- 172.21.15.62:0/1937767390 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f982c0033f0 con 0x7f984017da90 2022-09-17T10:27:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f9844af2700 1 -- 172.21.15.62:0/1937767390 >> v1:172.21.15.159:6789/0 conn(0x7f98400e5440 legacy=0x7f98400b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f983effd700 1 -- 172.21.15.62:0/1937767390 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797022000 0 0) 0x7f98400ec220 con 0x7f98400e5440 2022-09-17T10:27:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f9844af2700 1 -- 172.21.15.62:0/1937767390 >> v1:172.21.15.93:6789/0 conn(0x7f984017da90 legacy=0x7f98400e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f9844af2700 1 -- 172.21.15.62:0/1937767390 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98400ec7e0 con 0x7f984017de70 2022-09-17T10:27:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f9844af2700 1 --2- 172.21.15.62:0/1937767390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984017de70 0x7f98400b82d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9838009f20 tx=0x7f9838009840).ready entity=mon.2 client_cookie=f9648cc68b20241 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f983effd700 1 -- 172.21.15.62:0/1937767390 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800e070 con 0x7f984017de70 2022-09-17T10:27:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f983effd700 1 -- 172.21.15.62:0/1937767390 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983800b9d0 con 0x7f984017de70 2022-09-17T10:27:38.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.292+0000 7f983effd700 1 -- 172.21.15.62:0/1937767390 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800bd50 con 0x7f984017de70 2022-09-17T10:27:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.293+0000 7f98452f3700 1 -- 172.21.15.62:0/1937767390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984017de70 msgr2=0x7f98400b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.293+0000 7f98452f3700 1 --2- 172.21.15.62:0/1937767390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984017de70 0x7f98400b82d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9838009f20 tx=0x7f9838009840).stop 2022-09-17T10:27:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.293+0000 7f98452f3700 1 -- 172.21.15.62:0/1937767390 shutdown_connections 2022-09-17T10:27:38.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.293+0000 7f98452f3700 1 --2- 172.21.15.62:0/1937767390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984017de70 0x7f98400b82d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.293+0000 7f98452f3700 1 -- 172.21.15.62:0/1937767390 >> 172.21.15.62:0/1937767390 conn(0x7f984005d9a0 msgr2=0x7f984005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.293+0000 7f98452f3700 1 -- 172.21.15.62:0/1937767390 shutdown_connections 2022-09-17T10:27:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.293+0000 7f98452f3700 1 -- 172.21.15.62:0/1937767390 wait complete. 2022-09-17T10:27:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.294+0000 7f98452f3700 1 Processor -- start 2022-09-17T10:27:38.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.294+0000 7f98452f3700 1 -- start start 2022-09-17T10:27:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.295+0000 7f98452f3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400e5440 0x7f9840174ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.295+0000 7f98452f3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f984017da90 0x7f9840180eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.295+0000 7f98452f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f984017de70 0x7f98401813a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.295+0000 7f98452f3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984018f2f0 con 0x7f984017de70 2022-09-17T10:27:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.295+0000 7f98452f3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984018fb50 con 0x7f984017da90 2022-09-17T10:27:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.295+0000 7f98452f3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9840177600 con 0x7f98400e5440 2022-09-17T10:27:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f984017de70 0x7f98401813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f984017de70 0x7f98401813a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52644/0 (socket says 172.21.15.62:52644) 2022-09-17T10:27:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 -- 172.21.15.62:0/3802638105 learned_addr learned my addr 172.21.15.62:0/3802638105 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f983f7fe700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f984017da90 0x7f9840180eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f983ffff700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400e5440 0x7f9840174ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 -- 172.21.15.62:0/3802638105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400e5440 msgr2=0x7f9840174ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400e5440 0x7f9840174ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 -- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f984017da90 msgr2=0x7f9840180eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f984017da90 0x7f9840180eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 -- 172.21.15.62:0/3802638105 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009ae0 con 0x7f984017de70 2022-09-17T10:27:38.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9844af2700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f984017de70 0x7f98401813a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f98400efbb0 tx=0x7f9838009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9827fff700 1 -- 172.21.15.62:0/3802638105 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800bd50 con 0x7f984017de70 2022-09-17T10:27:38.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9827fff700 1 -- 172.21.15.62:0/3802638105 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983801c400 con 0x7f984017de70 2022-09-17T10:27:38.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9840181cf0 con 0x7f984017de70 2022-09-17T10:27:38.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f9827fff700 1 -- 172.21.15.62:0/3802638105 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983801c7a0 con 0x7f984017de70 2022-09-17T10:27:38.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.296+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984018f500 con 0x7f984017de70 2022-09-17T10:27:38.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.297+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984006be90 con 0x7f984017de70 2022-09-17T10:27:38.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.299+0000 7f9827fff700 1 -- 172.21.15.62:0/3802638105 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f9838023030 con 0x7f984017de70 2022-09-17T10:27:38.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.299+0000 7f9827fff700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f982008ba40 0x7f982008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.299+0000 7f9827fff700 1 -- 172.21.15.62:0/3802638105 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f98380b1860 con 0x7f984017de70 2022-09-17T10:27:38.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.299+0000 7f983ffff700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f982008ba40 0x7f982008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.300+0000 7f983ffff700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f982008ba40 0x7f982008df00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9834007640 tx=0x7f9834007bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.313 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.302+0000 7f9827fff700 1 -- 172.21.15.62:0/3802638105 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f9838082c10 con 0x7f984017de70 2022-09-17T10:27:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.472+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98400ecac0 con 0x7f984017de70 2022-09-17T10:27:38.475 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.472+0000 7f9827fff700 1 -- 172.21.15.62:0/3802638105 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9838021020 con 0x7f984017de70 2022-09-17T10:27:38.476 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2022-09-17T10:27:38.478 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f982008ba40 msgr2=0x7f982008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f982008ba40 0x7f982008df00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9834007640 tx=0x7f9834007bc0).stop 2022-09-17T10:27:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f984017de70 msgr2=0x7f98401813a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f984017de70 0x7f98401813a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f98400efbb0 tx=0x7f9838009840).stop 2022-09-17T10:27:38.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 shutdown_connections 2022-09-17T10:27:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f982008ba40 0x7f982008df00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f984017de70 0x7f98401813a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98400e5440 0x7f9840174ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 --2- 172.21.15.62:0/3802638105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f984017da90 0x7f9840180eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 >> 172.21.15.62:0/3802638105 conn(0x7f984005d9a0 msgr2=0x7f98400e4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 shutdown_connections 2022-09-17T10:27:38.482 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.474+0000 7f98452f3700 1 -- 172.21.15.62:0/3802638105 wait complete. 2022-09-17T10:27:38.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-17T10:27:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.606+0000 7ff5296d0700 1 Processor -- start 2022-09-17T10:27:38.609 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.607+0000 7ff5296d0700 1 -- start start 2022-09-17T10:27:38.617 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5296d0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff524175590 0x7ff524180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5296d0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5240c6dd0 con 0x7ff5241751b0 2022-09-17T10:27:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5296d0700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5241801e0 con 0x7ff5240ef650 2022-09-17T10:27:38.618 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5296d0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5240f10e0 con 0x7ff524175590 2022-09-17T10:27:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5227fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff524175590 0x7ff524180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff522ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff5241751b0 0x7ff524180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33262/0 (socket says 172.21.15.62:33262) 2022-09-17T10:27:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff522ffd700 1 -- 172.21.15.62:0/1281948584 learned_addr learned my addr 172.21.15.62:0/1281948584 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:38.619 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5227fc700 1 -- 172.21.15.62:0/1281948584 >> v1:172.21.15.159:6789/0 conn(0x7ff5240ef650 legacy=0x7ff5240efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5227fc700 1 -- 172.21.15.62:0/1281948584 >> v1:172.21.15.62:6789/0 conn(0x7ff5241751b0 legacy=0x7ff524180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5227fc700 1 -- 172.21.15.62:0/1281948584 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240f0840 con 0x7ff524175590 2022-09-17T10:27:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff5227fc700 1 --2- 172.21.15.62:0/1281948584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff524175590 0x7ff524180d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff50c009760 tx=0x7ff50c009060).ready entity=mon.0 client_cookie=21e58c64433266f9 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.620 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff521ffb700 1 -- 172.21.15.62:0/1281948584 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c009120 con 0x7ff524175590 2022-09-17T10:27:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff521ffb700 1 -- 172.21.15.62:0/1281948584 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c00b580 con 0x7ff524175590 2022-09-17T10:27:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.608+0000 7ff521ffb700 1 -- 172.21.15.62:0/1281948584 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00b900 con 0x7ff524175590 2022-09-17T10:27:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.609+0000 7ff5296d0700 1 -- 172.21.15.62:0/1281948584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff524175590 msgr2=0x7ff524180d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.621 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.609+0000 7ff5296d0700 1 --2- 172.21.15.62:0/1281948584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff524175590 0x7ff524180d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff50c009760 tx=0x7ff50c009060).stop 2022-09-17T10:27:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.609+0000 7ff5296d0700 1 -- 172.21.15.62:0/1281948584 shutdown_connections 2022-09-17T10:27:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.609+0000 7ff5296d0700 1 --2- 172.21.15.62:0/1281948584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff524175590 0x7ff524180d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.609+0000 7ff5296d0700 1 -- 172.21.15.62:0/1281948584 >> 172.21.15.62:0/1281948584 conn(0x7ff52406a170 msgr2=0x7ff5240f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:38.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.609+0000 7ff5296d0700 1 -- 172.21.15.62:0/1281948584 shutdown_connections 2022-09-17T10:27:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.609+0000 7ff5296d0700 1 -- 172.21.15.62:0/1281948584 wait complete. 2022-09-17T10:27:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.610+0000 7ff5296d0700 1 Processor -- start 2022-09-17T10:27:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.611+0000 7ff5296d0700 1 -- start start 2022-09-17T10:27:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.611+0000 7ff5296d0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5240ef650 0x7ff5240eec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.611+0000 7ff5296d0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5241751b0 0x7ff52416d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.611+0000 7ff5296d0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524175590 0x7ff52416d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.611+0000 7ff5296d0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240ef140 con 0x7ff5241751b0 2022-09-17T10:27:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.611+0000 7ff5296d0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52418f730 con 0x7ff5240ef650 2022-09-17T10:27:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.611+0000 7ff5296d0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52418f450 con 0x7ff524175590 2022-09-17T10:27:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5241751b0 0x7ff52416d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5241751b0 0x7ff52416d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52670/0 (socket says 172.21.15.62:52670) 2022-09-17T10:27:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 -- 172.21.15.62:0/156250937 learned_addr learned my addr 172.21.15.62:0/156250937 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5237fe700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524175590 0x7ff52416d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff522ffd700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5240ef650 0x7ff5240eec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 -- 172.21.15.62:0/156250937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524175590 msgr2=0x7ff52416d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.634 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524175590 0x7ff52416d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 -- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5240ef650 msgr2=0x7ff5240eec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5240ef650 0x7ff5240eec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 -- 172.21.15.62:0/156250937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0092a0 con 0x7ff5241751b0 2022-09-17T10:27:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff522ffd700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5240ef650 0x7ff5240eec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5227fc700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5241751b0 0x7ff52416d370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff50c009eb0 tx=0x7ff50c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff51affd700 1 -- 172.21.15.62:0/156250937 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c006910 con 0x7ff5241751b0 2022-09-17T10:27:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff51affd700 1 -- 172.21.15.62:0/156250937 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c00b6f0 con 0x7ff5241751b0 2022-09-17T10:27:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5240ec0c0 con 0x7ff5241751b0 2022-09-17T10:27:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff51affd700 1 -- 172.21.15.62:0/156250937 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c01b440 con 0x7ff5241751b0 2022-09-17T10:27:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.612+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5240ec680 con 0x7ff5241751b0 2022-09-17T10:27:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.613+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52406bf40 con 0x7ff5241751b0 2022-09-17T10:27:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.614+0000 7ff51affd700 1 -- 172.21.15.62:0/156250937 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff50c02a070 con 0x7ff5241751b0 2022-09-17T10:27:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.614+0000 7ff51affd700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff50808ba40 0x7ff50808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.614+0000 7ff51affd700 1 -- 172.21.15.62:0/156250937 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7ff50c0b19a0 con 0x7ff5241751b0 2022-09-17T10:27:38.641 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.615+0000 7ff522ffd700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff50808ba40 0x7ff50808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.615+0000 7ff522ffd700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff50808ba40 0x7ff50808df00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff51c0016b0 tx=0x7ff51c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.618+0000 7ff51affd700 1 -- 172.21.15.62:0/156250937 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7ff50c082cc0 con 0x7ff5241751b0 2022-09-17T10:27:38.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.835+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5240f0b20 con 0x7ff5241751b0 2022-09-17T10:27:38.838 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.836+0000 7ff51affd700 1 -- 172.21.15.62:0/156250937 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+9566 (secure 0 0 0) 0x7ff50c028090 con 0x7ff5241751b0 2022-09-17T10:27:38.839 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:38.839 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/2161434381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2161434381},{"type":"v1","addr":"172.21.15.62:6833","nonce":2161434381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/1194163827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1194163827},{"type":"v1","addr":"172.21.15.62:6839","nonce":1194163827}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/413826247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":413826247},{"type":"v1","addr":"172.21.15.93:6835","nonce":413826247}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4325,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3152394380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3152394380},{"type":"v1","addr":"172.21.15.159:6836","nonce":3152394380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2292269070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2292269070},{"type":"v1","addr":"172.21.15.62:6835","nonce":2292269070}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4327,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/301789402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":301789402},{"type":"v1","addr":"172.21.15.93:6837","nonce":301789402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4329,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1156565194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1156565194},{"type":"v1","addr":"172.21.15.62:6837","nonce":1156565194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4333,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6839/135709201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":135709201},{"type":"v1","addr":"172.21.15.93:6839","nonce":135709201}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4336,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6841/1241271614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6840","nonce":1241271614},{"type":"v1","addr":"172.21.15.93:6841","nonce":1241271614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/426632534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":426632534},{"type":"v1","addr":"172.21.15.159:6833","nonce":426632534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4360,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/574611303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":574611303},{"type":"v1","addr":"172.21.15.159:6839","nonce":574611303}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4365,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/802951039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":802951039},{"type":"v1","addr":"172.21.15.159:6837","nonce":802951039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-09-17T10:27:38.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff50808ba40 msgr2=0x7ff50808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff50808ba40 0x7ff50808df00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff51c0016b0 tx=0x7ff51c009040).stop 2022-09-17T10:27:38.842 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5241751b0 msgr2=0x7ff52416d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.842 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5241751b0 0x7ff52416d370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff50c009eb0 tx=0x7ff50c017000).stop 2022-09-17T10:27:38.843 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 shutdown_connections 2022-09-17T10:27:38.843 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff50808ba40 0x7ff50808df00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.843 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5240ef650 0x7ff5240eec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.843 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff524175590 0x7ff52416d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.844 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 --2- 172.21.15.62:0/156250937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5241751b0 0x7ff52416d370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.844 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 >> 172.21.15.62:0/156250937 conn(0x7ff52406a170 msgr2=0x7ff5240f4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:38.844 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 shutdown_connections 2022-09-17T10:27:38.844 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.838+0000 7ff5296d0700 1 -- 172.21.15.62:0/156250937 wait complete. 2022-09-17T10:27:38.845 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 3 2022-09-17T10:27:38.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:38.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.968+0000 7f0fc3add700 1 Processor -- start 2022-09-17T10:27:38.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.968+0000 7f0fc3add700 1 -- start start 2022-09-17T10:27:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc3add700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0fbc0f0000 0x7f0fbc063350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc3add700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0fbc063840 0x7f0fbc063cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc3add700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc062ec0 con 0x7f0fbc1785e0 2022-09-17T10:27:38.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc3add700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc17e1c0 con 0x7f0fbc0f0000 2022-09-17T10:27:38.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc3add700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc062010 con 0x7f0fbc063840 2022-09-17T10:27:38.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc1078700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0fbc0f0000 0x7f0fbc063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc1879700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0fbc1785e0 0x7f0fbc0ef8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33270/0 (socket says 172.21.15.62:33270) 2022-09-17T10:27:38.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc1879700 1 -- 172.21.15.62:0/2017527343 learned_addr learned my addr 172.21.15.62:0/2017527343 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc207a700 1 --2- 172.21.15.62:0/2017527343 >> v2:172.21.15.93:3300/0 conn(0x7f0fbc063840 0x7f0fbc063cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc1078700 1 -- 172.21.15.62:0/2017527343 >> v2:172.21.15.93:3300/0 conn(0x7f0fbc063840 msgr2=0x7f0fbc063cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc1078700 1 --2- 172.21.15.62:0/2017527343 >> v2:172.21.15.93:3300/0 conn(0x7f0fbc063840 0x7f0fbc063cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc1078700 1 -- 172.21.15.62:0/2017527343 >> v1:172.21.15.62:6789/0 conn(0x7f0fbc1785e0 legacy=0x7f0fbc0ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc1078700 1 -- 172.21.15.62:0/2017527343 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0622b0 con 0x7f0fbc0f0000 2022-09-17T10:27:38.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.969+0000 7f0fc0877700 1 -- 172.21.15.62:0/2017527343 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025353779 0 0) 0x7f0fbc062ec0 con 0x7f0fbc1785e0 2022-09-17T10:27:38.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc1078700 1 --2- 172.21.15.62:0/2017527343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc0f0000 0x7f0fbc063350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0fbc17f410 tx=0x7f0fb0009060).ready entity=mon.0 client_cookie=5dc30582e63307a4 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc0877700 1 -- 172.21.15.62:0/2017527343 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000b580 con 0x7f0fbc0f0000 2022-09-17T10:27:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc0877700 1 -- 172.21.15.62:0/2017527343 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000b6e0 con 0x7f0fbc0f0000 2022-09-17T10:27:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc0877700 1 -- 172.21.15.62:0/2017527343 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000ba60 con 0x7f0fbc0f0000 2022-09-17T10:27:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc3add700 1 -- 172.21.15.62:0/2017527343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc0f0000 msgr2=0x7f0fbc063350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc3add700 1 --2- 172.21.15.62:0/2017527343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc0f0000 0x7f0fbc063350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0fbc17f410 tx=0x7f0fb0009060).stop 2022-09-17T10:27:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc3add700 1 -- 172.21.15.62:0/2017527343 shutdown_connections 2022-09-17T10:27:38.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc3add700 1 --2- 172.21.15.62:0/2017527343 >> v2:172.21.15.93:3300/0 conn(0x7f0fbc063840 0x7f0fbc063cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc3add700 1 --2- 172.21.15.62:0/2017527343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc0f0000 0x7f0fbc063350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc3add700 1 -- 172.21.15.62:0/2017527343 >> 172.21.15.62:0/2017527343 conn(0x7f0fbc06a170 msgr2=0x7f0fbc0f4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:38.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc3add700 1 -- 172.21.15.62:0/2017527343 shutdown_connections 2022-09-17T10:27:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.970+0000 7f0fc3add700 1 -- 172.21.15.62:0/2017527343 wait complete. 2022-09-17T10:27:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.972+0000 7f0fc3add700 1 Processor -- start 2022-09-17T10:27:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.972+0000 7f0fc3add700 1 -- start start 2022-09-17T10:27:38.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc3add700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc063840 0x7f0fbc1736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc3add700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0fbc0f0000 0x7f0fbc1716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc3add700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fbc1785e0 0x7f0fbc0ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc3add700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc180ba0 con 0x7f0fbc063840 2022-09-17T10:27:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc3add700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0ebc80 con 0x7f0fbc0f0000 2022-09-17T10:27:38.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc3add700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc173bd0 con 0x7f0fbc1785e0 2022-09-17T10:27:38.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc063840 0x7f0fbc1736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc063840 0x7f0fbc1736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52686/0 (socket says 172.21.15.62:52686) 2022-09-17T10:27:38.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 -- 172.21.15.62:0/1001435638 learned_addr learned my addr 172.21.15.62:0/1001435638 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:38.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1078700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0fbc0f0000 0x7f0fbc1716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc207a700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fbc1785e0 0x7f0fbc0ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 -- 172.21.15.62:0/1001435638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fbc1785e0 msgr2=0x7f0fbc0ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fbc1785e0 0x7f0fbc0ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 -- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0fbc0f0000 msgr2=0x7f0fbc1716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0fbc0f0000 0x7f0fbc1716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 -- 172.21.15.62:0/1001435638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb00092a0 con 0x7f0fbc063840 2022-09-17T10:27:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc1879700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc063840 0x7f0fbc1736e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0fac00c840 tx=0x7f0fac007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fb9ffb700 1 -- 172.21.15.62:0/1001435638 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac005d30 con 0x7f0fbc063840 2022-09-17T10:27:38.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fb9ffb700 1 -- 172.21.15.62:0/1001435638 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac005e90 con 0x7f0fbc063840 2022-09-17T10:27:38.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc0ec7c0 con 0x7f0fbc063840 2022-09-17T10:27:38.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.973+0000 7f0fb9ffb700 1 -- 172.21.15.62:0/1001435638 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac007340 con 0x7f0fbc063840 2022-09-17T10:27:38.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.974+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc0ebe90 con 0x7f0fbc063840 2022-09-17T10:27:38.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.974+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc06bf40 con 0x7f0fbc063840 2022-09-17T10:27:38.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.975+0000 7f0fb9ffb700 1 -- 172.21.15.62:0/1001435638 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f0fac010030 con 0x7f0fbc063840 2022-09-17T10:27:38.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.976+0000 7f0fb9ffb700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0f9c08ba40 0x7f0f9c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:38.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.976+0000 7f0fb9ffb700 1 -- 172.21.15.62:0/1001435638 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f0fac0b00f0 con 0x7f0fbc063840 2022-09-17T10:27:38.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.976+0000 7f0fc1078700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0f9c08ba40 0x7f0f9c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:38.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.976+0000 7f0fc1078700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0f9c08ba40 0x7f0f9c08df00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0fb000b340 tx=0x7f0fb0017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:38.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:38.980+0000 7f0fb9ffb700 1 -- 172.21.15.62:0/1001435638 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f0fac0814a0 con 0x7f0fbc063840 2022-09-17T10:27:39.152 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.151+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fbc062590 con 0x7f0fbc063840 2022-09-17T10:27:39.153 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.152+0000 7f0fb9ffb700 1 -- 172.21.15.62:0/1001435638 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18366 (secure 0 0 0) 0x7f0fac084ac0 con 0x7f0fbc063840 2022-09-17T10:27:39.154 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:39.154 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:38.383970+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:39.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.153+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0f9c08ba40 msgr2=0x7f0f9c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.153+0000 7f0fc3add700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0f9c08ba40 0x7f0f9c08df00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0fb000b340 tx=0x7f0fb0017000).stop 2022-09-17T10:27:39.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.153+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc063840 msgr2=0x7f0fbc1736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.153+0000 7f0fc3add700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc063840 0x7f0fbc1736e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0fac00c840 tx=0x7f0fac007f90).stop 2022-09-17T10:27:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.154+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 shutdown_connections 2022-09-17T10:27:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.154+0000 7f0fc3add700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f0f9c08ba40 0x7f0f9c08df00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.154+0000 7f0fc3add700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fbc1785e0 0x7f0fbc0ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.154+0000 7f0fc3add700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fbc063840 0x7f0fbc1736e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.154+0000 7f0fc3add700 1 --2- 172.21.15.62:0/1001435638 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0fbc0f0000 0x7f0fbc1716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.154+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 >> 172.21.15.62:0/1001435638 conn(0x7f0fbc06a170 msgr2=0x7f0fbc0f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:39.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.154+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 shutdown_connections 2022-09-17T10:27:39.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.154+0000 7f0fc3add700 1 -- 172.21.15.62:0/1001435638 wait complete. 2022-09-17T10:27:39.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-09-17T10:27:32.392964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-09-17T10:27:35.474566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-09-17T10:27:39.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-09-17T10:27:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.287+0000 7f5035f95700 1 Processor -- start 2022-09-17T10:27:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.287+0000 7f5035f95700 1 -- start start 2022-09-17T10:27:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.288+0000 7f5035f95700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f50301751b0 0x7f5030180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.288+0000 7f5035f95700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300c6dd0 con 0x7f50300ef650 2022-09-17T10:27:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.288+0000 7f5035f95700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50301801e0 con 0x7f5030175590 2022-09-17T10:27:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.288+0000 7f5035f95700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50300f10e0 con 0x7f50301751b0 2022-09-17T10:27:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.288+0000 7f502ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f50300ef650 0x7f50300efa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33280/0 (socket says 172.21.15.62:33280) 2022-09-17T10:27:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.288+0000 7f502ffff700 1 -- 172.21.15.62:0/3312458931 learned_addr learned my addr 172.21.15.62:0/3312458931 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.288+0000 7f502f7fe700 1 --2- 172.21.15.62:0/3312458931 >> v2:172.21.15.159:3300/0 conn(0x7f50301751b0 0x7f5030180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502e7fc700 1 -- 172.21.15.62:0/3312458931 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381346584 0 0) 0x7f50300c6dd0 con 0x7f50300ef650 2022-09-17T10:27:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502e7fc700 1 -- 172.21.15.62:0/3312458931 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f501c0033f0 con 0x7f50300ef650 2022-09-17T10:27:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502f7fe700 1 -- 172.21.15.62:0/3312458931 >> v1:172.21.15.159:6789/0 conn(0x7f5030175590 legacy=0x7f5030180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502f7fe700 1 -- 172.21.15.62:0/3312458931 >> v1:172.21.15.62:6789/0 conn(0x7f50300ef650 legacy=0x7f50300efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502f7fe700 1 -- 172.21.15.62:0/3312458931 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50300f0840 con 0x7f50301751b0 2022-09-17T10:27:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502f7fe700 1 --2- 172.21.15.62:0/3312458931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50301751b0 0x7f5030180670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5020009760 tx=0x7f5020009060).ready entity=mon.2 client_cookie=29ee6ab89f87f124 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502e7fc700 1 -- 172.21.15.62:0/3312458931 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200090d0 con 0x7f50301751b0 2022-09-17T10:27:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502e7fc700 1 -- 172.21.15.62:0/3312458931 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000f510 con 0x7f50301751b0 2022-09-17T10:27:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f502e7fc700 1 -- 172.21.15.62:0/3312458931 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000f890 con 0x7f50301751b0 2022-09-17T10:27:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f5035f95700 1 -- 172.21.15.62:0/3312458931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50301751b0 msgr2=0x7f5030180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f5035f95700 1 --2- 172.21.15.62:0/3312458931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50301751b0 0x7f5030180670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5020009760 tx=0x7f5020009060).stop 2022-09-17T10:27:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f5035f95700 1 -- 172.21.15.62:0/3312458931 shutdown_connections 2022-09-17T10:27:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f5035f95700 1 --2- 172.21.15.62:0/3312458931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50301751b0 0x7f5030180670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f5035f95700 1 -- 172.21.15.62:0/3312458931 >> 172.21.15.62:0/3312458931 conn(0x7f503006a170 msgr2=0x7f50300f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.289+0000 7f5035f95700 1 -- 172.21.15.62:0/3312458931 shutdown_connections 2022-09-17T10:27:39.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.290+0000 7f5035f95700 1 -- 172.21.15.62:0/3312458931 wait complete. 2022-09-17T10:27:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.291+0000 7f5035f95700 1 Processor -- start 2022-09-17T10:27:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.291+0000 7f5035f95700 1 -- start start 2022-09-17T10:27:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f5035f95700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50300ef650 0x7f503016bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f5035f95700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50301751b0 0x7f503016e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f5035f95700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5030175590 0x7f503016e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f5035f95700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503016cf20 con 0x7f5030175590 2022-09-17T10:27:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f5035f95700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503016d200 con 0x7f50301751b0 2022-09-17T10:27:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f5035f95700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503016d4e0 con 0x7f50300ef650 2022-09-17T10:27:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5030175590 0x7f503016e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5030175590 0x7f503016e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52698/0 (socket says 172.21.15.62:52698) 2022-09-17T10:27:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502ffff700 1 -- 172.21.15.62:0/3230699730 learned_addr learned my addr 172.21.15.62:0/3230699730 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:39.305 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502effd700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50301751b0 0x7f503016e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502f7fe700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50300ef650 0x7f503016bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502ffff700 1 -- 172.21.15.62:0/3230699730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50300ef650 msgr2=0x7f503016bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502ffff700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50300ef650 0x7f503016bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502ffff700 1 -- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50301751b0 msgr2=0x7f503016e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.292+0000 7f502ffff700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50301751b0 0x7f503016e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.293+0000 7f502ffff700 1 -- 172.21.15.62:0/3230699730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50200092a0 con 0x7f5030175590 2022-09-17T10:27:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.293+0000 7f502effd700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50301751b0 0x7f503016e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:39.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.293+0000 7f502ffff700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5030175590 0x7f503016e790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5028002250 tx=0x7f5028007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.293+0000 7f50177fe700 1 -- 172.21.15.62:0/3230699730 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028005d30 con 0x7f5030175590 2022-09-17T10:27:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.293+0000 7f50177fe700 1 -- 172.21.15.62:0/3230699730 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5028005e90 con 0x7f5030175590 2022-09-17T10:27:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.293+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503016d7c0 con 0x7f5030175590 2022-09-17T10:27:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.293+0000 7f50177fe700 1 -- 172.21.15.62:0/3230699730 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028007360 con 0x7f5030175590 2022-09-17T10:27:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.293+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503016dd80 con 0x7f5030175590 2022-09-17T10:27:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.294+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50300884c0 con 0x7f5030175590 2022-09-17T10:27:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.295+0000 7f50177fe700 1 -- 172.21.15.62:0/3230699730 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f5028010030 con 0x7f5030175590 2022-09-17T10:27:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.295+0000 7f50177fe700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f501008ba40 0x7f501008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.295+0000 7f50177fe700 1 -- 172.21.15.62:0/3230699730 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f50280b0170 con 0x7f5030175590 2022-09-17T10:27:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.296+0000 7f502f7fe700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f501008ba40 0x7f501008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.296+0000 7f502f7fe700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f501008ba40 0x7f501008df00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5020006d10 tx=0x7f5020017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.299+0000 7f50177fe700 1 -- 172.21.15.62:0/3230699730 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f5028081520 con 0x7f5030175590 2022-09-17T10:27:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.475+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f503006bf40 con 0x7f5030175590 2022-09-17T10:27:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.475+0000 7f50177fe700 1 -- 172.21.15.62:0/3230699730 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f50280016e0 con 0x7f5030175590 2022-09-17T10:27:39.479 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2022-09-17T10:27:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f501008ba40 msgr2=0x7f501008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f501008ba40 0x7f501008df00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5020006d10 tx=0x7f5020017000).stop 2022-09-17T10:27:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5030175590 msgr2=0x7f503016e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5030175590 0x7f503016e790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5028002250 tx=0x7f5028007f50).stop 2022-09-17T10:27:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 shutdown_connections 2022-09-17T10:27:39.483 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f501008ba40 0x7f501008df00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5030175590 0x7f503016e790 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50300ef650 0x7f503016bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 --2- 172.21.15.62:0/3230699730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50301751b0 0x7f503016e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 >> 172.21.15.62:0/3230699730 conn(0x7f503006a170 msgr2=0x7f503017bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 shutdown_connections 2022-09-17T10:27:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.477+0000 7f5035f95700 1 -- 172.21.15.62:0/3230699730 wait complete. 2022-09-17T10:27:39.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-17T10:27:39.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.613+0000 7fb8e2198700 1 Processor -- start 2022-09-17T10:27:39.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.613+0000 7fb8e2198700 1 -- start start 2022-09-17T10:27:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8e2198700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb8dc175590 0x7fb8dc180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8e2198700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8dc0ef650 0x7fb8dc0efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8e2198700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc0c6dd0 con 0x7fb8dc1751b0 2022-09-17T10:27:39.619 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8e2198700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc0f10e0 con 0x7fb8dc0ef650 2022-09-17T10:27:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8e2198700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc1801e0 con 0x7fb8dc175590 2022-09-17T10:27:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8dbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8dc0ef650 0x7fb8dc0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.620 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8dbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8dc0ef650 0x7fb8dc0efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52706/0 (socket says 172.21.15.62:52706) 2022-09-17T10:27:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8dbfff700 1 -- 172.21.15.62:0/1602969466 learned_addr learned my addr 172.21.15.62:0/1602969466 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:39.621 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8daffd700 1 --2- 172.21.15.62:0/1602969466 >> v2:172.21.15.159:3300/0 conn(0x7fb8dc175590 0x7fb8dc180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8dbfff700 1 -- 172.21.15.62:0/1602969466 >> v2:172.21.15.159:3300/0 conn(0x7fb8dc175590 msgr2=0x7fb8dc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8dbfff700 1 --2- 172.21.15.62:0/1602969466 >> v2:172.21.15.159:3300/0 conn(0x7fb8dc175590 0x7fb8dc180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8dbfff700 1 -- 172.21.15.62:0/1602969466 >> v1:172.21.15.159:6789/0 conn(0x7fb8dc1751b0 legacy=0x7fb8dc180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8dbfff700 1 -- 172.21.15.62:0/1602969466 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0f0840 con 0x7fb8dc0ef650 2022-09-17T10:27:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8dbfff700 1 --2- 172.21.15.62:0/1602969466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0ef650 0x7fb8dc0efa90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb8dc085780 tx=0x7fb8d4009840).ready entity=mon.0 client_cookie=1f636cc57366e370 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.614+0000 7fb8da7fc700 1 -- 172.21.15.62:0/1602969466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d400e070 con 0x7fb8dc0ef650 2022-09-17T10:27:39.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8da7fc700 1 -- 172.21.15.62:0/1602969466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d400ba50 con 0x7fb8dc0ef650 2022-09-17T10:27:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8da7fc700 1 -- 172.21.15.62:0/1602969466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d400bdd0 con 0x7fb8dc0ef650 2022-09-17T10:27:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8e2198700 1 -- 172.21.15.62:0/1602969466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0ef650 msgr2=0x7fb8dc0efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1602969466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0ef650 0x7fb8dc0efa90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb8dc085780 tx=0x7fb8d4009840).stop 2022-09-17T10:27:39.624 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8e2198700 1 -- 172.21.15.62:0/1602969466 shutdown_connections 2022-09-17T10:27:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1602969466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc0ef650 0x7fb8dc0efa90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.625 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1602969466 >> v2:172.21.15.159:3300/0 conn(0x7fb8dc175590 0x7fb8dc180d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.626 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8e2198700 1 -- 172.21.15.62:0/1602969466 >> 172.21.15.62:0/1602969466 conn(0x7fb8dc06a170 msgr2=0x7fb8dc0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:39.626 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8e2198700 1 -- 172.21.15.62:0/1602969466 shutdown_connections 2022-09-17T10:27:39.626 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.615+0000 7fb8e2198700 1 -- 172.21.15.62:0/1602969466 wait complete. 2022-09-17T10:27:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.617+0000 7fb8e2198700 1 Processor -- start 2022-09-17T10:27:39.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.617+0000 7fb8e2198700 1 -- start start 2022-09-17T10:27:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8e2198700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8dc0ef650 0x7fb8dc16dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8e2198700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8dc1751b0 0x7fb8dc178ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8e2198700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc175590 0x7fb8dc1793c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8e2198700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc17d220 con 0x7fb8dc175590 2022-09-17T10:27:39.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8e2198700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc16e4a0 con 0x7fb8dc1751b0 2022-09-17T10:27:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8e2198700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc1799c0 con 0x7fb8dc0ef650 2022-09-17T10:27:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc175590 0x7fb8dc1793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc175590 0x7fb8dc1793c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52712/0 (socket says 172.21.15.62:52712) 2022-09-17T10:27:39.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 -- 172.21.15.62:0/1200259535 learned_addr learned my addr 172.21.15.62:0/1200259535 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8db7fe700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8dc0ef650 0x7fb8dc16dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8daffd700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8dc1751b0 0x7fb8dc178ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 -- 172.21.15.62:0/1200259535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8dc0ef650 msgr2=0x7fb8dc16dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8dc0ef650 0x7fb8dc16dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 -- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8dc1751b0 msgr2=0x7fb8dc178ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8dc1751b0 0x7fb8dc178ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 -- 172.21.15.62:0/1200259535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009ae0 con 0x7fb8dc175590 2022-09-17T10:27:39.634 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8db7fe700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8dc0ef650 0x7fb8dc16dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8dbfff700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc175590 0x7fb8dc1793c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb8d4009fd0 tx=0x7fb8d4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8c37fe700 1 -- 172.21.15.62:0/1200259535 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4007080 con 0x7fb8dc175590 2022-09-17T10:27:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8c37fe700 1 -- 172.21.15.62:0/1200259535 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d40092e0 con 0x7fb8dc175590 2022-09-17T10:27:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc179ca0 con 0x7fb8dc175590 2022-09-17T10:27:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8c37fe700 1 -- 172.21.15.62:0/1200259535 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d401e680 con 0x7fb8dc175590 2022-09-17T10:27:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.618+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc17ceb0 con 0x7fb8dc175590 2022-09-17T10:27:39.636 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.619+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc17d390 con 0x7fb8dc175590 2022-09-17T10:27:39.637 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.620+0000 7fb8c37fe700 1 -- 172.21.15.62:0/1200259535 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb8d4025030 con 0x7fb8dc175590 2022-09-17T10:27:39.637 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.621+0000 7fb8c37fe700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb8bc08ba70 0x7fb8bc08df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.637 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.621+0000 7fb8c37fe700 1 -- 172.21.15.62:0/1200259535 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fb8d40b1830 con 0x7fb8dc175590 2022-09-17T10:27:39.637 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.621+0000 7fb8db7fe700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb8bc08ba70 0x7fb8bc08df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.638 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.622+0000 7fb8db7fe700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb8bc08ba70 0x7fb8bc08df30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb8d0001760 tx=0x7fb8d0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.638 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.625+0000 7fb8c37fe700 1 -- 172.21.15.62:0/1200259535 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fb8d4082be0 con 0x7fb8dc175590 2022-09-17T10:27:39.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.796+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb8dc06bf40 con 0x7fb8dc175590 2022-09-17T10:27:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.797+0000 7fb8c37fe700 1 -- 172.21.15.62:0/1200259535 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb8d4023020 con 0x7fb8dc175590 2022-09-17T10:27:39.799 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2022-09-17T10:27:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb8bc08ba70 msgr2=0x7fb8bc08df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb8bc08ba70 0x7fb8bc08df30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb8d0001760 tx=0x7fb8d0009040).stop 2022-09-17T10:27:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc175590 msgr2=0x7fb8dc1793c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc175590 0x7fb8dc1793c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb8d4009fd0 tx=0x7fb8d4009840).stop 2022-09-17T10:27:39.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 shutdown_connections 2022-09-17T10:27:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb8bc08ba70 0x7fb8bc08df30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8dc175590 0x7fb8dc1793c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8dc0ef650 0x7fb8dc16dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.798+0000 7fb8e2198700 1 --2- 172.21.15.62:0/1200259535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8dc1751b0 0x7fb8dc178ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.799+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 >> 172.21.15.62:0/1200259535 conn(0x7fb8dc06a170 msgr2=0x7fb8dc0835c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.799+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 shutdown_connections 2022-09-17T10:27:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.799+0000 7fb8e2198700 1 -- 172.21.15.62:0/1200259535 wait complete. 2022-09-17T10:27:39.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-09-17T10:27:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.927+0000 7fb7f5b53700 1 Processor -- start 2022-09-17T10:27:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.927+0000 7fb7f5b53700 1 -- start start 2022-09-17T10:27:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.928+0000 7fb7f5b53700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb7f0174fc0 0x7fb7f00ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.942 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.928+0000 7fb7f5b53700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb7f00eb0d0 0x7fb7f00ee730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.928+0000 7fb7f5b53700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f00ed5b0 con 0x7fb7f01753a0 2022-09-17T10:27:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.928+0000 7fb7f5b53700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f0182b90 con 0x7fb7f00eb0d0 2022-09-17T10:27:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.928+0000 7fb7f5b53700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f00ed890 con 0x7fb7f0174fc0 2022-09-17T10:27:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f4b51700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb7f0174fc0 0x7fb7f00ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f5352700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb7f00eb0d0 0x7fb7f00ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f4b51700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb7f0174fc0 0x7fb7f00ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.62:36762/0 (socket says 172.21.15.62:36762) 2022-09-17T10:27:39.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f4b51700 1 -- 172.21.15.62:0/3878989625 learned_addr learned my addr 172.21.15.62:0/3878989625 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f4b51700 1 -- 172.21.15.62:0/3878989625 >> v2:172.21.15.93:3300/0 conn(0x7fb7f00eb0d0 msgr2=0x7fb7f00ee730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f4b51700 1 --2- 172.21.15.62:0/3878989625 >> v2:172.21.15.93:3300/0 conn(0x7fb7f00eb0d0 0x7fb7f00ee730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.945 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f4b51700 1 -- 172.21.15.62:0/3878989625 >> v1:172.21.15.93:6789/0 conn(0x7fb7f01753a0 legacy=0x7fb7f00ea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.946 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f4b51700 1 -- 172.21.15.62:0/3878989625 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00edb70 con 0x7fb7f0174fc0 2022-09-17T10:27:39.946 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7f4b51700 1 --2- 172.21.15.62:0/3878989625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 0x7fb7f00ecda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb7f006b0c0 tx=0x7fb7e8009840).ready entity=mon.2 client_cookie=6443944090678b3c server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.946 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7ef7fe700 1 -- 172.21.15.62:0/3878989625 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800e070 con 0x7fb7f0174fc0 2022-09-17T10:27:39.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7ef7fe700 1 -- 172.21.15.62:0/3878989625 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e800ba20 con 0x7fb7f0174fc0 2022-09-17T10:27:39.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.929+0000 7fb7ef7fe700 1 -- 172.21.15.62:0/3878989625 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800bda0 con 0x7fb7f0174fc0 2022-09-17T10:27:39.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.930+0000 7fb7f5b53700 1 -- 172.21.15.62:0/3878989625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 msgr2=0x7fb7f00ecda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.930+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/3878989625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 0x7fb7f00ecda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb7f006b0c0 tx=0x7fb7e8009840).stop 2022-09-17T10:27:39.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.930+0000 7fb7f5b53700 1 -- 172.21.15.62:0/3878989625 shutdown_connections 2022-09-17T10:27:39.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.930+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/3878989625 >> v2:172.21.15.93:3300/0 conn(0x7fb7f00eb0d0 0x7fb7f00ee730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.930+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/3878989625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 0x7fb7f00ecda0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.930+0000 7fb7f5b53700 1 -- 172.21.15.62:0/3878989625 >> 172.21.15.62:0/3878989625 conn(0x7fb7f005d9a0 msgr2=0x7fb7f005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:39.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.930+0000 7fb7f5b53700 1 -- 172.21.15.62:0/3878989625 shutdown_connections 2022-09-17T10:27:39.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.930+0000 7fb7f5b53700 1 -- 172.21.15.62:0/3878989625 wait complete. 2022-09-17T10:27:39.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.931+0000 7fb7f5b53700 1 Processor -- start 2022-09-17T10:27:39.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.931+0000 7fb7f5b53700 1 -- start start 2022-09-17T10:27:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.932+0000 7fb7f5b53700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7f00eb0d0 0x7fb7f0152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.950 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.932+0000 7fb7f5b53700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 0x7fb7f0152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.932+0000 7fb7f5b53700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7f01753a0 0x7fb7f018f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.932+0000 7fb7f5b53700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0190850 con 0x7fb7f01753a0 2022-09-17T10:27:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.932+0000 7fb7f5b53700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0180cc0 con 0x7fb7f00eb0d0 2022-09-17T10:27:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.932+0000 7fb7f5b53700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0180fa0 con 0x7fb7f0174fc0 2022-09-17T10:27:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7f01753a0 0x7fb7f018f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7f01753a0 0x7fb7f018f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52726/0 (socket says 172.21.15.62:52726) 2022-09-17T10:27:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 -- 172.21.15.62:0/1837567790 learned_addr learned my addr 172.21.15.62:0/1837567790 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f4b51700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7f00eb0d0 0x7fb7f0152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.952 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7effff700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 0x7fb7f0152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 -- 172.21.15.62:0/1837567790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 msgr2=0x7fb7f0152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 0x7fb7f0152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 -- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7f00eb0d0 msgr2=0x7fb7f0152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7f00eb0d0 0x7fb7f0152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 -- 172.21.15.62:0/1837567790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8009ae0 con 0x7fb7f01753a0 2022-09-17T10:27:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7effff700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 0x7fb7f0152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:39.954 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5352700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7f01753a0 0x7fb7f018f070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb7e000e900 tx=0x7fb7e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7ecff9700 1 -- 172.21.15.62:0/1837567790 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0012600 con 0x7fb7f01753a0 2022-09-17T10:27:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7ecff9700 1 -- 172.21.15.62:0/1837567790 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0012760 con 0x7fb7f01753a0 2022-09-17T10:27:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7ecff9700 1 -- 172.21.15.62:0/1837567790 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0012ae0 con 0x7fb7f01753a0 2022-09-17T10:27:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f018ff20 con 0x7fb7f01753a0 2022-09-17T10:27:39.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.933+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f01904e0 con 0x7fb7f01753a0 2022-09-17T10:27:39.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.934+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f01909c0 con 0x7fb7f01753a0 2022-09-17T10:27:39.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.935+0000 7fb7ecff9700 1 -- 172.21.15.62:0/1837567790 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb7e0022070 con 0x7fb7f01753a0 2022-09-17T10:27:39.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.935+0000 7fb7ecff9700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb7d408ba40 0x7fb7d408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:39.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.935+0000 7fb7ecff9700 1 -- 172.21.15.62:0/1837567790 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fb7e00b04e0 con 0x7fb7f01753a0 2022-09-17T10:27:39.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.936+0000 7fb7f4b51700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb7d408ba40 0x7fb7d408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:39.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.936+0000 7fb7f4b51700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb7d408ba40 0x7fb7d408df00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb7e8009880 tx=0x7fb7f00ee410).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:39.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:39.939+0000 7fb7ecff9700 1 -- 172.21.15.62:0/1837567790 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fb7e0081780 con 0x7fb7f01753a0 2022-09-17T10:27:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.114+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb7f018f980 con 0x7fb7f01753a0 2022-09-17T10:27:40.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.114+0000 7fb7ecff9700 1 -- 172.21.15.62:0/1837567790 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v23) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb7e0016020 con 0x7fb7f01753a0 2022-09-17T10:27:40.117 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:40.118 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2022-09-17T10:27:40.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2022-09-17T10:27:40.119 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2022-09-17T10:27:40.119 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "device_health_metrics" 2022-09-17T10:27:40.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2022-09-17T10:27:40.120 INFO:teuthology.orchestra.run.smithi062.stdout: { 2022-09-17T10:27:40.120 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2022-09-17T10:27:40.121 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2022-09-17T10:27:40.121 INFO:teuthology.orchestra.run.smithi062.stdout: } 2022-09-17T10:27:40.122 INFO:teuthology.orchestra.run.smithi062.stdout:] 2022-09-17T10:27:40.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb7d408ba40 msgr2=0x7fb7d408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:40.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb7d408ba40 0x7fb7d408df00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb7e8009880 tx=0x7fb7f00ee410).stop 2022-09-17T10:27:40.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7f01753a0 msgr2=0x7fb7f018f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7f01753a0 0x7fb7f018f070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb7e000e900 tx=0x7fb7e0009060).stop 2022-09-17T10:27:40.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 shutdown_connections 2022-09-17T10:27:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb7d408ba40 0x7fb7d408df00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:40.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7f00eb0d0 0x7fb7f0152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7f01753a0 0x7fb7f018f070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:40.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 --2- 172.21.15.62:0/1837567790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7f0174fc0 0x7fb7f0152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:40.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 >> 172.21.15.62:0/1837567790 conn(0x7fb7f005d9a0 msgr2=0x7fb7f00baaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:40.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 shutdown_connections 2022-09-17T10:27:40.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.116+0000 7fb7f5b53700 1 -- 172.21.15.62:0/1837567790 wait complete. 2022-09-17T10:27:40.130 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-09-17T10:27:40.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2022-09-17T10:27:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.252+0000 7f090f4d7700 1 Processor -- start 2022-09-17T10:27:40.254 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.252+0000 7f090f4d7700 1 -- start start 2022-09-17T10:27:40.257 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.253+0000 7f090f4d7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0908062950 0x7f0908062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:40.257 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.253+0000 7f090f4d7700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09080c6dd0 con 0x7f0908175590 2022-09-17T10:27:40.257 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.253+0000 7f090f4d7700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09080642c0 con 0x7f09081751b0 2022-09-17T10:27:40.257 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.253+0000 7f090f4d7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09080f10e0 con 0x7f0908062950 2022-09-17T10:27:40.258 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.253+0000 7f090da74700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0908062950 0x7f0908062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:40.258 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.253+0000 7f090da74700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0908062950 0x7f0908062dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52730/0 (socket says 172.21.15.62:52730) 2022-09-17T10:27:40.258 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.253+0000 7f090da74700 1 -- 172.21.15.62:0/1402705367 learned_addr learned my addr 172.21.15.62:0/1402705367 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:40.258 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f090da74700 1 -- 172.21.15.62:0/1402705367 >> v1:172.21.15.159:6789/0 conn(0x7f09081751b0 legacy=0x7f0908180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f090da74700 1 -- 172.21.15.62:0/1402705367 >> v1:172.21.15.93:6789/0 conn(0x7f0908175590 legacy=0x7f0908180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f090da74700 1 -- 172.21.15.62:0/1402705367 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09081801e0 con 0x7f0908062950 2022-09-17T10:27:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f090da74700 1 --2- 172.21.15.62:0/1402705367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908062950 0x7f0908062dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f08f8006fd0 tx=0x7f08f80090f0).ready entity=mon.0 client_cookie=4cc79f35582dbb52 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f0907fff700 1 -- 172.21.15.62:0/1402705367 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800b600 con 0x7f0908062950 2022-09-17T10:27:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f0907fff700 1 -- 172.21.15.62:0/1402705367 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f800b760 con 0x7f0908062950 2022-09-17T10:27:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f0907fff700 1 -- 172.21.15.62:0/1402705367 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800bb00 con 0x7f0908062950 2022-09-17T10:27:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f090f4d7700 1 -- 172.21.15.62:0/1402705367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908062950 msgr2=0x7f0908062dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.254+0000 7f090f4d7700 1 --2- 172.21.15.62:0/1402705367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908062950 0x7f0908062dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f08f8006fd0 tx=0x7f08f80090f0).stop 2022-09-17T10:27:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.255+0000 7f090f4d7700 1 -- 172.21.15.62:0/1402705367 shutdown_connections 2022-09-17T10:27:40.261 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.255+0000 7f090f4d7700 1 --2- 172.21.15.62:0/1402705367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908062950 0x7f0908062dc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:40.261 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.255+0000 7f090f4d7700 1 -- 172.21.15.62:0/1402705367 >> 172.21.15.62:0/1402705367 conn(0x7f090806a170 msgr2=0x7f09080f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:40.261 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.255+0000 7f090f4d7700 1 -- 172.21.15.62:0/1402705367 shutdown_connections 2022-09-17T10:27:40.261 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.255+0000 7f090f4d7700 1 -- 172.21.15.62:0/1402705367 wait complete. 2022-09-17T10:27:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.256+0000 7f090f4d7700 1 Processor -- start 2022-09-17T10:27:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.256+0000 7f090f4d7700 1 -- start start 2022-09-17T10:27:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090f4d7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0908062950 0x7f090817da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090f4d7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09081751b0 0x7f0908085820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:40.268 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090f4d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908175590 0x7f090816f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:40.268 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090f4d7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080f0660 con 0x7f0908175590 2022-09-17T10:27:40.268 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090f4d7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080cad90 con 0x7f09081751b0 2022-09-17T10:27:40.268 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090f4d7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090816f650 con 0x7f0908062950 2022-09-17T10:27:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090da74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908175590 0x7f090816f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090da74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908175590 0x7f090816f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52734/0 (socket says 172.21.15.62:52734) 2022-09-17T10:27:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.257+0000 7f090da74700 1 -- 172.21.15.62:0/1182065832 learned_addr learned my addr 172.21.15.62:0/1182065832 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090ca72700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09081751b0 0x7f0908085820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:40.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090d273700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0908062950 0x7f090817da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090da74700 1 -- 172.21.15.62:0/1182065832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0908062950 msgr2=0x7f090817da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090da74700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0908062950 0x7f090817da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090da74700 1 -- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09081751b0 msgr2=0x7f0908085820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090da74700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09081751b0 0x7f0908085820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090da74700 1 -- 172.21.15.62:0/1182065832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f8009370 con 0x7f0908175590 2022-09-17T10:27:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090da74700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908175590 0x7f090816f160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f08f8009f50 tx=0x7f08f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f09057fa700 1 -- 172.21.15.62:0/1182065832 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800bec0 con 0x7f0908175590 2022-09-17T10:27:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f09057fa700 1 -- 172.21.15.62:0/1182065832 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f800bae0 con 0x7f0908175590 2022-09-17T10:27:40.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0908085e80 con 0x7f0908175590 2022-09-17T10:27:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f09057fa700 1 -- 172.21.15.62:0/1182065832 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8024680 con 0x7f0908175590 2022-09-17T10:27:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.258+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0908086440 con 0x7f0908175590 2022-09-17T10:27:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.259+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09080caf00 con 0x7f0908175590 2022-09-17T10:27:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.260+0000 7f09057fa700 1 -- 172.21.15.62:0/1182065832 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f08f800f070 con 0x7f0908175590 2022-09-17T10:27:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.260+0000 7f09057fa700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f08e808ba40 0x7f08e808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.261+0000 7f09057fa700 1 -- 172.21.15.62:0/1182065832 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f08f80b2110 con 0x7f0908175590 2022-09-17T10:27:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.261+0000 7f090d273700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f08e808ba40 0x7f08e808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.261+0000 7f090d273700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f08e808ba40 0x7f08e808df00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0900007fd0 tx=0x7f0900009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:40.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.265+0000 7f09057fa700 1 -- 172.21.15.62:0/1182065832 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f08f80834c0 con 0x7f0908175590 2022-09-17T10:27:40.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:40.436+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f090806bf40 con 0x7f0908175590 2022-09-17T10:27:41.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.399+0000 7f09057fa700 1 -- 172.21.15.62:0/1182065832 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v24) v1 ==== 152+0+0 (secure 0 0 0) 0x7f08f8086ae0 con 0x7f0908175590 2022-09-17T10:27:41.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f08e808ba40 msgr2=0x7f08e808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:41.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f08e808ba40 0x7f08e808df00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0900007fd0 tx=0x7f0900009040).stop 2022-09-17T10:27:41.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908175590 msgr2=0x7f090816f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:41.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908175590 0x7f090816f160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f08f8009f50 tx=0x7f08f8017000).stop 2022-09-17T10:27:41.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 shutdown_connections 2022-09-17T10:27:41.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f08e808ba40 0x7f08e808df00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0908175590 0x7f090816f160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0908062950 0x7f090817da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 --2- 172.21.15.62:0/1182065832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09081751b0 0x7f0908085820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 >> 172.21.15.62:0/1182065832 conn(0x7f090806a170 msgr2=0x7f0908180670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:41.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 shutdown_connections 2022-09-17T10:27:41.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.402+0000 7f090f4d7700 1 -- 172.21.15.62:0/1182065832 wait complete. 2022-09-17T10:27:41.408 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2022-09-17T10:27:41.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2022-09-17T10:27:41.554 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.551+0000 7f546aeac700 1 Processor -- start 2022-09-17T10:27:41.554 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.551+0000 7f546aeac700 1 -- start start 2022-09-17T10:27:41.565 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.552+0000 7f546aeac700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f546417df60 0x7f54640e3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:41.565 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.552+0000 7f546aeac700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f546417fb50 0x7f546417ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:41.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f546aeac700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54640e5a20 con 0x7f5464181c50 2022-09-17T10:27:41.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f546aeac700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54641804a0 con 0x7f546417df60 2022-09-17T10:27:41.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f546aeac700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54640e4b30 con 0x7f546417fb50 2022-09-17T10:27:41.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5468c48700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f546417df60 0x7f54640e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:41.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5463fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f546417fb50 0x7f546417ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:41.567 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5463fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f546417fb50 0x7f546417ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.62:36790/0 (socket says 172.21.15.62:36790) 2022-09-17T10:27:41.567 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5463fff700 1 -- 172.21.15.62:0/3086840381 learned_addr learned my addr 172.21.15.62:0/3086840381 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:41.568 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5463fff700 1 -- 172.21.15.62:0/3086840381 >> v2:172.21.15.93:3300/0 conn(0x7f546417df60 msgr2=0x7f54640e3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:41.568 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5463fff700 1 --2- 172.21.15.62:0/3086840381 >> v2:172.21.15.93:3300/0 conn(0x7f546417df60 0x7f54640e3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.568 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5463fff700 1 -- 172.21.15.62:0/3086840381 >> v1:172.21.15.93:6789/0 conn(0x7f5464181c50 legacy=0x7f54641820e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:41.568 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5463fff700 1 -- 172.21.15.62:0/3086840381 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54640e4e10 con 0x7f546417fb50 2022-09-17T10:27:41.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.553+0000 7f5463fff700 1 --2- 172.21.15.62:0/3086840381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f546417fb50 0x7f546417ffb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5458006fd0 tx=0x7f54580090f0).ready entity=mon.2 client_cookie=4226033b92a5ac26 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:41.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f54637fe700 1 -- 172.21.15.62:0/3086840381 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800b520 con 0x7f546417fb50 2022-09-17T10:27:41.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f54637fe700 1 -- 172.21.15.62:0/3086840381 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545800b680 con 0x7f546417fb50 2022-09-17T10:27:41.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f54637fe700 1 -- 172.21.15.62:0/3086840381 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800ba00 con 0x7f546417fb50 2022-09-17T10:27:41.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f546aeac700 1 -- 172.21.15.62:0/3086840381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f546417fb50 msgr2=0x7f546417ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:41.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f546aeac700 1 --2- 172.21.15.62:0/3086840381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f546417fb50 0x7f546417ffb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5458006fd0 tx=0x7f54580090f0).stop 2022-09-17T10:27:41.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f546aeac700 1 -- 172.21.15.62:0/3086840381 shutdown_connections 2022-09-17T10:27:41.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f546aeac700 1 --2- 172.21.15.62:0/3086840381 >> v2:172.21.15.93:3300/0 conn(0x7f546417df60 0x7f54640e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f546aeac700 1 --2- 172.21.15.62:0/3086840381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f546417fb50 0x7f546417ffb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f546aeac700 1 -- 172.21.15.62:0/3086840381 >> 172.21.15.62:0/3086840381 conn(0x7f54640de720 msgr2=0x7f54640ef140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:41.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f546aeac700 1 -- 172.21.15.62:0/3086840381 shutdown_connections 2022-09-17T10:27:41.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.554+0000 7f546aeac700 1 -- 172.21.15.62:0/3086840381 wait complete. 2022-09-17T10:27:41.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.556+0000 7f546aeac700 1 Processor -- start 2022-09-17T10:27:41.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.556+0000 7f546aeac700 1 -- start start 2022-09-17T10:27:41.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f546aeac700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f546417df60 0x7f5464151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:41.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f546aeac700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546417fb50 0x7f54640e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:41.573 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f546aeac700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5464181c50 0x7f5464151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:41.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f546aeac700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5464152410 con 0x7f546417fb50 2022-09-17T10:27:41.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f546aeac700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640e0f60 con 0x7f546417df60 2022-09-17T10:27:41.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f546aeac700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640e0070 con 0x7f5464181c50 2022-09-17T10:27:41.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f5463fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546417fb50 0x7f54640e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:41.575 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f5463fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546417fb50 0x7f54640e13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52744/0 (socket says 172.21.15.62:52744) 2022-09-17T10:27:41.575 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f5463fff700 1 -- 172.21.15.62:0/3421847897 learned_addr learned my addr 172.21.15.62:0/3421847897 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:41.575 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f5468c48700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f546417df60 0x7f5464151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:41.575 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.557+0000 7f5469449700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5464181c50 0x7f5464151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:41.576 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5463fff700 1 -- 172.21.15.62:0/3421847897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5464181c50 msgr2=0x7f5464151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:41.576 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5463fff700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5464181c50 0x7f5464151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.576 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5463fff700 1 -- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f546417df60 msgr2=0x7f5464151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:41.576 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5463fff700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f546417df60 0x7f5464151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:41.577 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5463fff700 1 -- 172.21.15.62:0/3421847897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458009370 con 0x7f546417fb50 2022-09-17T10:27:41.577 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5468c48700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f546417df60 0x7f5464151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:41.577 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5463fff700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546417fb50 0x7f54640e13f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f54640e4c70 tx=0x7f5458015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:41.577 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5460ff9700 1 -- 172.21.15.62:0/3421847897 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800be90 con 0x7f546417fb50 2022-09-17T10:27:41.578 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5460ff9700 1 -- 172.21.15.62:0/3421847897 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545800b7f0 con 0x7f546417fb50 2022-09-17T10:27:41.578 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f5460ff9700 1 -- 172.21.15.62:0/3421847897 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545801c670 con 0x7f546417fb50 2022-09-17T10:27:41.578 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54640e0350 con 0x7f546417fb50 2022-09-17T10:27:41.578 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.558+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54640e0910 con 0x7f546417fb50 2022-09-17T10:27:41.579 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.559+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546405f600 con 0x7f546417fb50 2022-09-17T10:27:41.579 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.560+0000 7f5460ff9700 1 -- 172.21.15.62:0/3421847897 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f545802c070 con 0x7f546417fb50 2022-09-17T10:27:41.579 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.560+0000 7f5460ff9700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f544408ba40 0x7f544408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:41.579 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.560+0000 7f5460ff9700 1 -- 172.21.15.62:0/3421847897 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7479+0+0 (secure 0 0 0) 0x7f54580b1ec0 con 0x7f546417fb50 2022-09-17T10:27:41.580 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.560+0000 7f5468c48700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f544408ba40 0x7f544408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:41.580 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.561+0000 7f5468c48700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f544408ba40 0x7f544408df00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f545c0076c0 tx=0x7f545c00b040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:41.581 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.564+0000 7f5460ff9700 1 -- 172.21.15.62:0/3421847897 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f5458083100 con 0x7f546417fb50 2022-09-17T10:27:41.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:41.737+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f54640e50f0 con 0x7f546417fb50 2022-09-17T10:27:42.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.402+0000 7f5460ff9700 1 -- 172.21.15.62:0/3421847897 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v25) v1 ==== 171+0+0 (secure 0 0 0) 0x7f54580200d0 con 0x7f546417fb50 2022-09-17T10:27:42.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f544408ba40 msgr2=0x7f544408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f544408ba40 0x7f544408df00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f545c0076c0 tx=0x7f545c00b040).stop 2022-09-17T10:27:42.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546417fb50 msgr2=0x7f54640e13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546417fb50 0x7f54640e13f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f54640e4c70 tx=0x7f5458015000).stop 2022-09-17T10:27:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 shutdown_connections 2022-09-17T10:27:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f544408ba40 0x7f544408df00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f546417df60 0x7f5464151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5464181c50 0x7f5464151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 --2- 172.21.15.62:0/3421847897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546417fb50 0x7f54640e13f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.408+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 >> 172.21.15.62:0/3421847897 conn(0x7f54640de720 msgr2=0x7f54640e70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:42.413 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.410+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 shutdown_connections 2022-09-17T10:27:42.414 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.411+0000 7f546aeac700 1 -- 172.21.15.62:0/3421847897 wait complete. 2022-09-17T10:27:42.425 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2022-09-17T10:27:42.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-09-17T10:27:42.565 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.563+0000 7fd8c1621700 1 Processor -- start 2022-09-17T10:27:42.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.563+0000 7fd8c1621700 1 -- start start 2022-09-17T10:27:42.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8c1621700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8bc1785e0 0x7fd8bc0ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8c1621700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc062ec0 con 0x7fd8bc063a60 2022-09-17T10:27:42.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8c1621700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc17e1c0 con 0x7fd8bc0efde0 2022-09-17T10:27:42.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8c1621700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc062010 con 0x7fd8bc1785e0 2022-09-17T10:27:42.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8baffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8bc1785e0 0x7fd8bc0ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8baffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8bc1785e0 0x7fd8bc0ef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52754/0 (socket says 172.21.15.62:52754) 2022-09-17T10:27:42.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8baffd700 1 -- 172.21.15.62:0/3424813623 learned_addr learned my addr 172.21.15.62:0/3424813623 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:42.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8baffd700 1 -- 172.21.15.62:0/3424813623 >> v1:172.21.15.159:6789/0 conn(0x7fd8bc0efde0 legacy=0x7fd8bc063350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8baffd700 1 -- 172.21.15.62:0/3424813623 >> v1:172.21.15.93:6789/0 conn(0x7fd8bc063a60 legacy=0x7fd8bc184c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8baffd700 1 -- 172.21.15.62:0/3424813623 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc0622b0 con 0x7fd8bc1785e0 2022-09-17T10:27:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.564+0000 7fd8baffd700 1 --2- 172.21.15.62:0/3424813623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0ef8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd8ac006fd0 tx=0x7fd8ac0090f0).ready entity=mon.0 client_cookie=c08e1e51629b8c6a server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8b9ffb700 1 -- 172.21.15.62:0/3424813623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00b600 con 0x7fd8bc1785e0 2022-09-17T10:27:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8b9ffb700 1 -- 172.21.15.62:0/3424813623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00b760 con 0x7fd8bc1785e0 2022-09-17T10:27:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8b9ffb700 1 -- 172.21.15.62:0/3424813623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00bae0 con 0x7fd8bc1785e0 2022-09-17T10:27:42.573 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8c1621700 1 -- 172.21.15.62:0/3424813623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 msgr2=0x7fd8bc0ef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.573 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8c1621700 1 --2- 172.21.15.62:0/3424813623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0ef8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd8ac006fd0 tx=0x7fd8ac0090f0).stop 2022-09-17T10:27:42.573 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8c1621700 1 -- 172.21.15.62:0/3424813623 shutdown_connections 2022-09-17T10:27:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8c1621700 1 --2- 172.21.15.62:0/3424813623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0ef8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8c1621700 1 -- 172.21.15.62:0/3424813623 >> 172.21.15.62:0/3424813623 conn(0x7fd8bc06a170 msgr2=0x7fd8bc0f4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8c1621700 1 -- 172.21.15.62:0/3424813623 shutdown_connections 2022-09-17T10:27:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.565+0000 7fd8c1621700 1 -- 172.21.15.62:0/3424813623 wait complete. 2022-09-17T10:27:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.567+0000 7fd8c1621700 1 Processor -- start 2022-09-17T10:27:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.567+0000 7fd8c1621700 1 -- start start 2022-09-17T10:27:42.580 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8c1621700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8bc063a60 0x7fd8bc171940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.580 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8c1621700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0efde0 0x7fd8bc171e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.580 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8c1621700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.581 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8c1621700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0cb110 con 0x7fd8bc1785e0 2022-09-17T10:27:42.581 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8c1621700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc181b50 con 0x7fd8bc063a60 2022-09-17T10:27:42.581 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8c1621700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc181e30 con 0x7fd8bc0efde0 2022-09-17T10:27:42.581 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.582 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52764/0 (socket says 172.21.15.62:52764) 2022-09-17T10:27:42.582 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 -- 172.21.15.62:0/3968338795 learned_addr learned my addr 172.21.15.62:0/3968338795 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:42.582 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8ba7fc700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0efde0 0x7fd8bc171e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.582 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8baffd700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8bc063a60 0x7fd8bc171940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.583 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 -- 172.21.15.62:0/3968338795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0efde0 msgr2=0x7fd8bc171e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.583 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0efde0 0x7fd8bc171e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.583 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 -- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8bc063a60 msgr2=0x7fd8bc171940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.583 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8bc063a60 0x7fd8bc171940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.583 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 -- 172.21.15.62:0/3968338795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac009370 con 0x7fd8bc1785e0 2022-09-17T10:27:42.584 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8baffd700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8bc063a60 0x7fd8bc171940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:42.584 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8bb7fe700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0cb5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd8b4002230 tx=0x7fd8b40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:42.585 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8a2ffd700 1 -- 172.21.15.62:0/3968338795 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4010510 con 0x7fd8bc1785e0 2022-09-17T10:27:42.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.568+0000 7fd8a2ffd700 1 -- 172.21.15.62:0/3968338795 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b4010670 con 0x7fd8bc1785e0 2022-09-17T10:27:42.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.569+0000 7fd8a2ffd700 1 -- 172.21.15.62:0/3968338795 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40109f0 con 0x7fd8bc1785e0 2022-09-17T10:27:42.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.569+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc182110 con 0x7fd8bc1785e0 2022-09-17T10:27:42.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.569+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc0cada0 con 0x7fd8bc1785e0 2022-09-17T10:27:42.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.569+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc0caf60 con 0x7fd8bc1785e0 2022-09-17T10:27:42.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.570+0000 7fd8a2ffd700 1 -- 172.21.15.62:0/3968338795 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fd8b4010070 con 0x7fd8bc1785e0 2022-09-17T10:27:42.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.571+0000 7fd8a2ffd700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd89c08ba40 0x7fd89c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.571+0000 7fd8a2ffd700 1 -- 172.21.15.62:0/3968338795 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 7861+0+0 (secure 0 0 0) 0x7fd8b40b0c60 con 0x7fd8bc1785e0 2022-09-17T10:27:42.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.571+0000 7fd8baffd700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd89c08ba40 0x7fd89c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.572+0000 7fd8baffd700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd89c08ba40 0x7fd89c08df00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd8ac009130 tx=0x7fd8ac017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.574+0000 7fd8a2ffd700 1 -- 172.21.15.62:0/3968338795 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fd8b4081d20 con 0x7fd8bc1785e0 2022-09-17T10:27:42.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.791+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd8bc0eba70 con 0x7fd8bc1785e0 2022-09-17T10:27:42.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.796+0000 7fd8a2ffd700 1 -- 172.21.15.62:0/3968338795 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd8b4085340 con 0x7fd8bc1785e0 2022-09-17T10:27:42.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd89c08ba40 msgr2=0x7fd89c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd89c08ba40 0x7fd89c08df00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd8ac009130 tx=0x7fd8ac017000).stop 2022-09-17T10:27:42.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 msgr2=0x7fd8bc0cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0cb5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd8b4002230 tx=0x7fd8b40015e0).stop 2022-09-17T10:27:42.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 shutdown_connections 2022-09-17T10:27:42.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd89c08ba40 0x7fd89c08df00 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0x7fd8ac009130 tx=0x7fd8ac017000).stop 2022-09-17T10:27:42.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8bc063a60 0x7fd8bc171940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8bc1785e0 0x7fd8bc0cb5a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 --2- 172.21.15.62:0/3968338795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8bc0efde0 0x7fd8bc171e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.800+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 >> 172.21.15.62:0/3968338795 conn(0x7fd8bc06a170 msgr2=0x7fd8bc0c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:42.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.802+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 shutdown_connections 2022-09-17T10:27:42.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.802+0000 7fd8c1621700 1 -- 172.21.15.62:0/3968338795 wait complete. 2022-09-17T10:27:42.810 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 3 and data pool 4 2022-09-17T10:27:42.824 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2022-09-17T10:27:42.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2022-09-17T10:27:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.944+0000 7f173aa7c700 1 Processor -- start 2022-09-17T10:27:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.945+0000 7f173aa7c700 1 -- start start 2022-09-17T10:27:42.954 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f173aa7c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1734156f40 0x7f17340ed620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f173aa7c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f17340835c0 0x7f1734083a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f173aa7c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340eca80 con 0x7f1734156b60 2022-09-17T10:27:42.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f173aa7c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17341811e0 con 0x7f1734156f40 2022-09-17T10:27:42.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f173aa7c700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17341814c0 con 0x7f17340835c0 2022-09-17T10:27:42.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f1738818700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1734156b60 0x7f17340ecf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33286/0 (socket says 172.21.15.62:33286) 2022-09-17T10:27:42.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f1738818700 1 -- 172.21.15.62:0/3851077923 learned_addr learned my addr 172.21.15.62:0/3851077923 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:42.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594701811 0 0) 0x7f17340eca80 con 0x7f1734156b60 2022-09-17T10:27:42.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17200033f0 con 0x7f1734156b60 2022-09-17T10:27:42.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f1733fff700 1 --2- 172.21.15.62:0/3851077923 >> v2:172.21.15.93:3300/0 conn(0x7f1734156f40 0x7f17340ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f1739019700 1 --2- 172.21.15.62:0/3851077923 >> v2:172.21.15.159:3300/0 conn(0x7f17340835c0 0x7f1734083a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2754149551 0 0) 0x7f17200033f0 con 0x7f1734156b60 2022-09-17T10:27:42.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 >> v2:172.21.15.159:3300/0 conn(0x7f17340835c0 msgr2=0x7f1734083a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:42.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 --2- 172.21.15.62:0/3851077923 >> v2:172.21.15.159:3300/0 conn(0x7f17340835c0 0x7f1734083a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 >> v2:172.21.15.93:3300/0 conn(0x7f1734156f40 msgr2=0x7f17340ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 --2- 172.21.15.62:0/3851077923 >> v2:172.21.15.93:3300/0 conn(0x7f1734156f40 0x7f17340ed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17341817a0 con 0x7f1734156b60 2022-09-17T10:27:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f172c0017f0 con 0x7f1734156b60 2022-09-17T10:27:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 >> v1:172.21.15.62:6789/0 conn(0x7f1734156b60 legacy=0x7f17340ecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1720003930 0x7f1720003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1720004690 0x7f1720004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720005000 0x7f172000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341811e0 con 0x7f1720004690 2022-09-17T10:27:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341814c0 con 0x7f1720005000 2022-09-17T10:27:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172000be80 con 0x7f1720003930 2022-09-17T10:27:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.946+0000 7f1733fff700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1720004690 0x7f1720004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1738818700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1720003930 0x7f1720003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1739019700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720005000 0x7f172000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1733fff700 1 -- 172.21.15.62:0/3851077923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1720003930 msgr2=0x7f1720003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:42.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1733fff700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1720003930 0x7f1720003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1733fff700 1 -- 172.21.15.62:0/3851077923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720005000 msgr2=0x7f172000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:42.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1733fff700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720005000 0x7f172000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1733fff700 1 -- 172.21.15.62:0/3851077923 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200033f0 con 0x7f1720004690 2022-09-17T10:27:42.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1739019700 1 -- 172.21.15.62:0/3851077923 reap_dead start 2022-09-17T10:27:42.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f1733fff700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1720004690 0x7f1720004b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1728009a80 tx=0x7f1728009060).ready entity=mon.0 client_cookie=a8fee409c86181c8 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:42.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728009430 con 0x7f1720004690 2022-09-17T10:27:42.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172800e640 con 0x7f1720004690 2022-09-17T10:27:42.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f17337fe700 1 -- 172.21.15.62:0/3851077923 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172800e9c0 con 0x7f1720004690 2022-09-17T10:27:42.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f173aa7c700 1 -- 172.21.15.62:0/3851077923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1720004690 msgr2=0x7f1720004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f173aa7c700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1720004690 0x7f1720004b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1728009a80 tx=0x7f1728009060).stop 2022-09-17T10:27:42.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f173aa7c700 1 -- 172.21.15.62:0/3851077923 shutdown_connections 2022-09-17T10:27:42.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f173aa7c700 1 --2- 172.21.15.62:0/3851077923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1720004690 0x7f1720004b10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.947+0000 7f173aa7c700 1 -- 172.21.15.62:0/3851077923 >> 172.21.15.62:0/3851077923 conn(0x7f17340ee490 msgr2=0x7f17340ee8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:42.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.948+0000 7f173aa7c700 1 -- 172.21.15.62:0/3851077923 shutdown_connections 2022-09-17T10:27:42.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.948+0000 7f173aa7c700 1 -- 172.21.15.62:0/3851077923 wait complete. 2022-09-17T10:27:42.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.949+0000 7f173aa7c700 1 Processor -- start 2022-09-17T10:27:42.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.949+0000 7f173aa7c700 1 -- start start 2022-09-17T10:27:42.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f173aa7c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720004690 0x7f17341523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f173aa7c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340f04b0 0x7f1734170060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f173aa7c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1734170550 0x7f17341853b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f173aa7c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734180c80 con 0x7f17340f04b0 2022-09-17T10:27:42.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f173aa7c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341709d0 con 0x7f1720004690 2022-09-17T10:27:42.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f173aa7c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341528c0 con 0x7f1734170550 2022-09-17T10:27:42.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1733fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340f04b0 0x7f1734170060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1733fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340f04b0 0x7f1734170060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52782/0 (socket says 172.21.15.62:52782) 2022-09-17T10:27:42.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1733fff700 1 -- 172.21.15.62:0/3210350232 learned_addr learned my addr 172.21.15.62:0/3210350232 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:42.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1738818700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720004690 0x7f17341523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1739019700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1734170550 0x7f17341853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1733fff700 1 -- 172.21.15.62:0/3210350232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1734170550 msgr2=0x7f17341853b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1733fff700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1734170550 0x7f17341853b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1733fff700 1 -- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720004690 msgr2=0x7f17341523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:42.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1733fff700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720004690 0x7f17341523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1733fff700 1 -- 172.21.15.62:0/3210350232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17341809a0 con 0x7f17340f04b0 2022-09-17T10:27:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.950+0000 7f1739019700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1734170550 0x7f17341853b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.951+0000 7f1733fff700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340f04b0 0x7f1734170060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f172800e4b0 tx=0x7f172801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.951+0000 7f1730ff9700 1 -- 172.21.15.62:0/3210350232 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172800ed30 con 0x7f17340f04b0 2022-09-17T10:27:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.951+0000 7f1730ff9700 1 -- 172.21.15.62:0/3210350232 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172800eeb0 con 0x7f17340f04b0 2022-09-17T10:27:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.951+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340ef6f0 con 0x7f17340f04b0 2022-09-17T10:27:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.951+0000 7f1730ff9700 1 -- 172.21.15.62:0/3210350232 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728025440 con 0x7f17340f04b0 2022-09-17T10:27:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.951+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17340efcb0 con 0x7f17340f04b0 2022-09-17T10:27:42.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.952+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173406bf40 con 0x7f17340f04b0 2022-09-17T10:27:42.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.953+0000 7f1730ff9700 1 -- 172.21.15.62:0/3210350232 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f172802b020 con 0x7f17340f04b0 2022-09-17T10:27:42.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.953+0000 7f1730ff9700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f171408ba40 0x7f171408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:42.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.954+0000 7f1730ff9700 1 -- 172.21.15.62:0/3210350232 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7961+0+0 (secure 0 0 0) 0x7f17280b1d00 con 0x7f17340f04b0 2022-09-17T10:27:42.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.954+0000 7f1738818700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f171408ba40 0x7f171408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:42.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.954+0000 7f1738818700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f171408ba40 0x7f171408df00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f172c002250 tx=0x7f17340ec9f0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:42.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:42.958+0000 7f1730ff9700 1 -- 172.21.15.62:0/3210350232 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f17280b5030 con 0x7f17340f04b0 2022-09-17T10:27:43.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.139+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f17340ec430 con 0x7f17340f04b0 2022-09-17T10:27:43.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.803+0000 7f1730ff9700 1 -- 172.21.15.62:0/3210350232 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v27) v1 ==== 157+0+0 (secure 0 0 0) 0x7f1728016020 con 0x7f17340f04b0 2022-09-17T10:27:43.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f171408ba40 msgr2=0x7f171408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:43.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f171408ba40 0x7f171408df00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f172c002250 tx=0x7f17340ec9f0).stop 2022-09-17T10:27:43.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340f04b0 msgr2=0x7f1734170060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:43.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340f04b0 0x7f1734170060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f172800e4b0 tx=0x7f172801a000).stop 2022-09-17T10:27:43.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 shutdown_connections 2022-09-17T10:27:43.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f171408ba40 0x7f171408df00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:43.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1720004690 0x7f17341523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:43.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1734170550 0x7f17341853b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:43.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 --2- 172.21.15.62:0/3210350232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340f04b0 0x7f1734170060 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:43.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 >> 172.21.15.62:0/3210350232 conn(0x7f17340ee490 msgr2=0x7f173405d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:43.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 shutdown_connections 2022-09-17T10:27:43.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.806+0000 7f173aa7c700 1 -- 172.21.15.62:0/3210350232 wait complete. 2022-09-17T10:27:43.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2022-09-17T10:27:43.954 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.952+0000 7fdbd9b6f700 1 Processor -- start 2022-09-17T10:27:43.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.952+0000 7fdbd9b6f700 1 -- start start 2022-09-17T10:27:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd9b6f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdbd4174d70 0x7fdbd4182380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd9b6f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd417cce0 con 0x7fdbd417d880 2022-09-17T10:27:43.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd9b6f700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd40e46c0 con 0x7fdbd4175150 2022-09-17T10:27:43.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd9b6f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40e72f0 con 0x7fdbd4174d70 2022-09-17T10:27:43.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd37fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdbd4174d70 0x7fdbd4182380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:43.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd37fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdbd4174d70 0x7fdbd4182380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52784/0 (socket says 172.21.15.62:52784) 2022-09-17T10:27:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd37fe700 1 -- 172.21.15.62:0/1034677742 learned_addr learned my addr 172.21.15.62:0/1034677742 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd37fe700 1 -- 172.21.15.62:0/1034677742 >> v1:172.21.15.159:6789/0 conn(0x7fdbd4175150 legacy=0x7fdbd417d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd37fe700 1 -- 172.21.15.62:0/1034677742 >> v1:172.21.15.93:6789/0 conn(0x7fdbd417d880 legacy=0x7fdbd40e3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd37fe700 1 -- 172.21.15.62:0/1034677742 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40e49a0 con 0x7fdbd4174d70 2022-09-17T10:27:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd37fe700 1 --2- 172.21.15.62:0/1034677742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd4174d70 0x7fdbd4182380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdbc4006fd0 tx=0x7fdbc40090f0).ready entity=mon.0 client_cookie=95b3d2a2cac6b138 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd27fc700 1 -- 172.21.15.62:0/1034677742 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400b600 con 0x7fdbd4174d70 2022-09-17T10:27:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd27fc700 1 -- 172.21.15.62:0/1034677742 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc400b760 con 0x7fdbd4174d70 2022-09-17T10:27:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.954+0000 7fdbd27fc700 1 -- 172.21.15.62:0/1034677742 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400bae0 con 0x7fdbd4174d70 2022-09-17T10:27:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.955+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/1034677742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd4174d70 msgr2=0x7fdbd4182380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:43.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.955+0000 7fdbd9b6f700 1 --2- 172.21.15.62:0/1034677742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd4174d70 0x7fdbd4182380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdbc4006fd0 tx=0x7fdbc40090f0).stop 2022-09-17T10:27:43.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.955+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/1034677742 shutdown_connections 2022-09-17T10:27:43.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.955+0000 7fdbd9b6f700 1 --2- 172.21.15.62:0/1034677742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd4174d70 0x7fdbd4182380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:43.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.955+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/1034677742 >> 172.21.15.62:0/1034677742 conn(0x7fdbd40ecda0 msgr2=0x7fdbd40eb850 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:43.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.955+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/1034677742 shutdown_connections 2022-09-17T10:27:43.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.955+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/1034677742 wait complete. 2022-09-17T10:27:43.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.956+0000 7fdbd9b6f700 1 Processor -- start 2022-09-17T10:27:43.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.956+0000 7fdbd9b6f700 1 -- start start 2022-09-17T10:27:43.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.957+0000 7fdbd9b6f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbd4174d70 0x7fdbd416dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:43.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.957+0000 7fdbd9b6f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbd4175150 0x7fdbd418d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:43.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.957+0000 7fdbd9b6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd417d880 0x7fdbd418d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:43.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.957+0000 7fdbd9b6f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd416e0f0 con 0x7fdbd417d880 2022-09-17T10:27:43.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.957+0000 7fdbd9b6f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd418ccd0 con 0x7fdbd4175150 2022-09-17T10:27:43.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.957+0000 7fdbd9b6f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4191320 con 0x7fdbd4174d70 2022-09-17T10:27:43.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd417d880 0x7fdbd418d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:43.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd417d880 0x7fdbd418d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52796/0 (socket says 172.21.15.62:52796) 2022-09-17T10:27:43.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 -- 172.21.15.62:0/741147074 learned_addr learned my addr 172.21.15.62:0/741147074 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:43.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd37fe700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbd4174d70 0x7fdbd416dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:43.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd2ffd700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbd4175150 0x7fdbd418d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:43.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 -- 172.21.15.62:0/741147074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbd4174d70 msgr2=0x7fdbd416dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:43.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbd4174d70 0x7fdbd416dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:43.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 -- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbd4175150 msgr2=0x7fdbd418d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:43.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbd4175150 0x7fdbd418d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:43.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 -- 172.21.15.62:0/741147074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4009370 con 0x7fdbd417d880 2022-09-17T10:27:43.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd2ffd700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbd4175150 0x7fdbd418d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:43.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd3fff700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd417d880 0x7fdbd418d650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdbcc00c7c0 tx=0x7fdbcc001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:43.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbbb7fe700 1 -- 172.21.15.62:0/741147074 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc010510 con 0x7fdbd417d880 2022-09-17T10:27:43.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbbb7fe700 1 -- 172.21.15.62:0/741147074 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc010670 con 0x7fdbd417d880 2022-09-17T10:27:43.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbbb7fe700 1 -- 172.21.15.62:0/741147074 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0109f0 con 0x7fdbd417d880 2022-09-17T10:27:43.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd4191600 con 0x7fdbd417d880 2022-09-17T10:27:43.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.958+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd418c680 con 0x7fdbd417d880 2022-09-17T10:27:43.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.959+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd405f600 con 0x7fdbd417d880 2022-09-17T10:27:43.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.960+0000 7fdbbb7fe700 1 -- 172.21.15.62:0/741147074 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fdbcc010070 con 0x7fdbd417d880 2022-09-17T10:27:43.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.960+0000 7fdbbb7fe700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdbb408ba40 0x7fdbb408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:43.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.961+0000 7fdbbb7fe700 1 -- 172.21.15.62:0/741147074 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8220+0+0 (secure 0 0 0) 0x7fdbcc0b03f0 con 0x7fdbd417d880 2022-09-17T10:27:43.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.961+0000 7fdbd37fe700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdbb408ba40 0x7fdbb408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:43.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.961+0000 7fdbd37fe700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdbb408ba40 0x7fdbb408df00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdbc4009130 tx=0x7fdbc4017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:43.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:43.964+0000 7fdbbb7fe700 1 -- 172.21.15.62:0/741147074 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fdbcc081240 con 0x7fdbd417d880 2022-09-17T10:27:44.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:44.133+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdbd417c0d0 con 0x7fdbd417d880 2022-09-17T10:27:44.524 INFO:tasks.ceph.mds.f.smithi159.stderr:2022-09-17T10:27:44.522+0000 7f9d5a22d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2022-09-17T10:27:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.818+0000 7fdbbb7fe700 1 -- 172.21.15.62:0/741147074 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v29) v1 ==== 228+0+0 (secure 0 0 0) 0x7fdbcc084860 con 0x7fdbd417d880 2022-09-17T10:27:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdbb408ba40 msgr2=0x7fdbb408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdbb408ba40 0x7fdbb408df00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdbc4009130 tx=0x7fdbc4017000).stop 2022-09-17T10:27:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd417d880 msgr2=0x7fdbd418d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd417d880 0x7fdbd418d650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdbcc00c7c0 tx=0x7fdbcc001510).stop 2022-09-17T10:27:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 shutdown_connections 2022-09-17T10:27:45.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdbb408ba40 0x7fdbb408df00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:45.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd417d880 0x7fdbd418d650 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:45.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbd4174d70 0x7fdbd416dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:45.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 --2- 172.21.15.62:0/741147074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbd4175150 0x7fdbd418d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:45.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 >> 172.21.15.62:0/741147074 conn(0x7fdbd40ecda0 msgr2=0x7fdbd40e9840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:45.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.822+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 shutdown_connections 2022-09-17T10:27:45.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.823+0000 7fdbd9b6f700 1 -- 172.21.15.62:0/741147074 wait complete. 2022-09-17T10:27:45.828 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data_ec' created 2022-09-17T10:27:45.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2022-09-17T10:27:45.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.969+0000 7f457cafd700 1 Processor -- start 2022-09-17T10:27:45.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.969+0000 7f457cafd700 1 -- start start 2022-09-17T10:27:45.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f457cafd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45781751b0 0x7f4578180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:45.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f457cafd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45780c6dd0 con 0x7f4578175590 2022-09-17T10:27:45.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f457cafd700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45781801e0 con 0x7f45780ef650 2022-09-17T10:27:45.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f457cafd700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45780f10e0 con 0x7f45781751b0 2022-09-17T10:27:45.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f4575d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4578175590 0x7f4578180b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58870/0 (socket says 172.21.15.62:58870) 2022-09-17T10:27:45.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f4575d9b700 1 -- 172.21.15.62:0/3030406606 learned_addr learned my addr 172.21.15.62:0/3030406606 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:45.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f457659c700 1 --2- 172.21.15.62:0/3030406606 >> v2:172.21.15.159:3300/0 conn(0x7f45781751b0 0x7f4578180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:45.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f457559a700 1 -- 172.21.15.62:0/3030406606 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200115474 0 0) 0x7f45780c6dd0 con 0x7f4578175590 2022-09-17T10:27:45.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.970+0000 7f457559a700 1 -- 172.21.15.62:0/3030406606 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45580033f0 con 0x7f4578175590 2022-09-17T10:27:45.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457659c700 1 -- 172.21.15.62:0/3030406606 >> v1:172.21.15.93:6789/0 conn(0x7f45780ef650 legacy=0x7f45780efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:45.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457659c700 1 -- 172.21.15.62:0/3030406606 >> v1:172.21.15.62:6789/0 conn(0x7f4578175590 legacy=0x7f4578180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:45.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457659c700 1 -- 172.21.15.62:0/3030406606 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780f0840 con 0x7f45781751b0 2022-09-17T10:27:45.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457659c700 1 --2- 172.21.15.62:0/3030406606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45781751b0 0x7f4578180670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f4570009760 tx=0x7f4570009060).ready entity=mon.2 client_cookie=f581c5205f666adc server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:45.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457559a700 1 -- 172.21.15.62:0/3030406606 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700090d0 con 0x7f45781751b0 2022-09-17T10:27:45.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457559a700 1 -- 172.21.15.62:0/3030406606 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000f510 con 0x7f45781751b0 2022-09-17T10:27:45.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457559a700 1 -- 172.21.15.62:0/3030406606 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000f890 con 0x7f45781751b0 2022-09-17T10:27:45.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457cafd700 1 -- 172.21.15.62:0/3030406606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45781751b0 msgr2=0x7f4578180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:45.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457cafd700 1 --2- 172.21.15.62:0/3030406606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45781751b0 0x7f4578180670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f4570009760 tx=0x7f4570009060).stop 2022-09-17T10:27:45.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457cafd700 1 -- 172.21.15.62:0/3030406606 shutdown_connections 2022-09-17T10:27:45.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457cafd700 1 --2- 172.21.15.62:0/3030406606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45781751b0 0x7f4578180670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:45.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457cafd700 1 -- 172.21.15.62:0/3030406606 >> 172.21.15.62:0/3030406606 conn(0x7f457806a170 msgr2=0x7f45780f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:45.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457cafd700 1 -- 172.21.15.62:0/3030406606 shutdown_connections 2022-09-17T10:27:45.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.971+0000 7f457cafd700 1 -- 172.21.15.62:0/3030406606 wait complete. 2022-09-17T10:27:45.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.973+0000 7f457cafd700 1 Processor -- start 2022-09-17T10:27:45.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.973+0000 7f457cafd700 1 -- start start 2022-09-17T10:27:45.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457cafd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780ef650 0x7f4578062950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:45.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457cafd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45781751b0 0x7f457816d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:45.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457cafd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4578175590 0x7f457816dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:45.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457cafd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780631f0 con 0x7f45780ef650 2022-09-17T10:27:45.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457cafd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780634d0 con 0x7f45781751b0 2022-09-17T10:27:45.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457cafd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780637b0 con 0x7f4578175590 2022-09-17T10:27:45.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780ef650 0x7f4578062950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:45.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780ef650 0x7f4578062950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36806/0 (socket says 172.21.15.62:36806) 2022-09-17T10:27:45.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 -- 172.21.15.62:0/1281894341 learned_addr learned my addr 172.21.15.62:0/1281894341 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:45.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f4575d9b700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45781751b0 0x7f457816d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:45.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 -- 172.21.15.62:0/1281894341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4578175590 msgr2=0x7f457816dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:45.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f4576d9d700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4578175590 0x7f457816dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:45.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4578175590 0x7f457816dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:45.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 -- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45781751b0 msgr2=0x7f457816d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:45.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45781751b0 0x7f457816d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:45.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 -- 172.21.15.62:0/1281894341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700092a0 con 0x7f45780ef650 2022-09-17T10:27:45.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f4576d9d700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4578175590 0x7f457816dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:45.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f4575d9b700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45781751b0 0x7f457816d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:45.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.974+0000 7f457659c700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780ef650 0x7f4578062950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4578088960 tx=0x7f4570017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:45.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.975+0000 7f456e7fc700 1 -- 172.21.15.62:0/1281894341 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570009e30 con 0x7f45780ef650 2022-09-17T10:27:45.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.975+0000 7f456e7fc700 1 -- 172.21.15.62:0/1281894341 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000fc50 con 0x7f45780ef650 2022-09-17T10:27:45.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.975+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4578063a90 con 0x7f45780ef650 2022-09-17T10:27:45.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.975+0000 7f456e7fc700 1 -- 172.21.15.62:0/1281894341 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457001b410 con 0x7f45780ef650 2022-09-17T10:27:45.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.975+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4578190f50 con 0x7f45780ef650 2022-09-17T10:27:45.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.976+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457805f600 con 0x7f45780ef650 2022-09-17T10:27:45.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.977+0000 7f456e7fc700 1 -- 172.21.15.62:0/1281894341 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f457000f070 con 0x7f45780ef650 2022-09-17T10:27:45.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.978+0000 7f456e7fc700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f455c08ba40 0x7f455c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:45.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.978+0000 7f456e7fc700 1 -- 172.21.15.62:0/1281894341 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8713+0+0 (secure 0 0 0) 0x7f45700b24a0 con 0x7f45780ef650 2022-09-17T10:27:45.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.978+0000 7f4575d9b700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f455c08ba40 0x7f455c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:45.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.978+0000 7f4575d9b700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f455c08ba40 0x7f455c08df00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4560005750 tx=0x7f4560009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:45.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:45.981+0000 7f456e7fc700 1 -- 172.21.15.62:0/1281894341 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f4570083180 con 0x7f45780ef650 2022-09-17T10:27:46.151 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.150+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f457806bf40 con 0x7f45780ef650 2022-09-17T10:27:46.822 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.820+0000 7f456e7fc700 1 -- 172.21.15.62:0/1281894341 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4570028070 con 0x7f45780ef650 2022-09-17T10:27:46.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.824+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f455c08ba40 msgr2=0x7f455c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.824+0000 7f457cafd700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f455c08ba40 0x7f455c08df00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4560005750 tx=0x7f4560009040).stop 2022-09-17T10:27:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.824+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780ef650 msgr2=0x7f4578062950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.824+0000 7f457cafd700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780ef650 0x7f4578062950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4578088960 tx=0x7f4570017000).stop 2022-09-17T10:27:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.826+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 shutdown_connections 2022-09-17T10:27:46.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.826+0000 7f457cafd700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f455c08ba40 0x7f455c08df00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.826+0000 7f457cafd700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4578175590 0x7f457816dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.832 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.826+0000 7f457cafd700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45780ef650 0x7f4578062950 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.832 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.826+0000 7f457cafd700 1 --2- 172.21.15.62:0/1281894341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45781751b0 0x7f457816d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.832 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.826+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 >> 172.21.15.62:0/1281894341 conn(0x7f457806a170 msgr2=0x7f457816e930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:46.833 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.826+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 shutdown_connections 2022-09-17T10:27:46.833 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.826+0000 7f457cafd700 1 -- 172.21.15.62:0/1281894341 wait complete. 2022-09-17T10:27:46.834 INFO:teuthology.orchestra.run.smithi062.stderr:set pool 5 allow_ec_overwrites to true 2022-09-17T10:27:46.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2022-09-17T10:27:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.969+0000 7fadc7765700 1 Processor -- start 2022-09-17T10:27:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.970+0000 7fadc7765700 1 -- start start 2022-09-17T10:27:46.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc7765700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fadc0175590 0x7fadc0180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc7765700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fadc00ef650 0x7fadc00efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc7765700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00c6dd0 con 0x7fadc01751b0 2022-09-17T10:27:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc7765700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00f10e0 con 0x7fadc00ef650 2022-09-17T10:27:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc7765700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc01801e0 con 0x7fadc0175590 2022-09-17T10:27:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5d02700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fadc00ef650 0x7fadc00efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5d02700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fadc00ef650 0x7fadc00efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36814/0 (socket says 172.21.15.62:36814) 2022-09-17T10:27:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5501700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fadc01751b0 0x7fadc0180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58886/0 (socket says 172.21.15.62:58886) 2022-09-17T10:27:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5d02700 1 -- 172.21.15.62:0/2201445580 learned_addr learned my addr 172.21.15.62:0/2201445580 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc4d00700 1 --2- 172.21.15.62:0/2201445580 >> v2:172.21.15.93:3300/0 conn(0x7fadc0175590 0x7fadc0180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5d02700 1 -- 172.21.15.62:0/2201445580 >> v2:172.21.15.93:3300/0 conn(0x7fadc0175590 msgr2=0x7fadc0180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5d02700 1 --2- 172.21.15.62:0/2201445580 >> v2:172.21.15.93:3300/0 conn(0x7fadc0175590 0x7fadc0180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5d02700 1 -- 172.21.15.62:0/2201445580 >> v1:172.21.15.62:6789/0 conn(0x7fadc01751b0 legacy=0x7fadc0180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5d02700 1 -- 172.21.15.62:0/2201445580 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00f0840 con 0x7fadc00ef650 2022-09-17T10:27:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadbffff700 1 -- 172.21.15.62:0/2201445580 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444715832 0 0) 0x7fadc00c6dd0 con 0x7fadc01751b0 2022-09-17T10:27:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadc5d02700 1 --2- 172.21.15.62:0/2201445580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc00efa90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fadc0085780 tx=0x7fadb00090f0).ready entity=mon.0 client_cookie=3e9211bc554d5978 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadbffff700 1 -- 172.21.15.62:0/2201445580 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000b520 con 0x7fadc00ef650 2022-09-17T10:27:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadbffff700 1 -- 172.21.15.62:0/2201445580 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb000b680 con 0x7fadc00ef650 2022-09-17T10:27:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.971+0000 7fadbffff700 1 -- 172.21.15.62:0/2201445580 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000ba20 con 0x7fadc00ef650 2022-09-17T10:27:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.972+0000 7fadc7765700 1 -- 172.21.15.62:0/2201445580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 msgr2=0x7fadc00efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.972+0000 7fadc7765700 1 --2- 172.21.15.62:0/2201445580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc00efa90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fadc0085780 tx=0x7fadb00090f0).stop 2022-09-17T10:27:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.972+0000 7fadc7765700 1 -- 172.21.15.62:0/2201445580 shutdown_connections 2022-09-17T10:27:46.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.972+0000 7fadc7765700 1 --2- 172.21.15.62:0/2201445580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc00efa90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.972+0000 7fadc7765700 1 --2- 172.21.15.62:0/2201445580 >> v2:172.21.15.93:3300/0 conn(0x7fadc0175590 0x7fadc0180d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.972+0000 7fadc7765700 1 -- 172.21.15.62:0/2201445580 >> 172.21.15.62:0/2201445580 conn(0x7fadc006a170 msgr2=0x7fadc00f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:46.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.972+0000 7fadc7765700 1 -- 172.21.15.62:0/2201445580 shutdown_connections 2022-09-17T10:27:46.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.972+0000 7fadc7765700 1 -- 172.21.15.62:0/2201445580 wait complete. 2022-09-17T10:27:46.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.973+0000 7fadc7765700 1 Processor -- start 2022-09-17T10:27:46.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.973+0000 7fadc7765700 1 -- start start 2022-09-17T10:27:46.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.974+0000 7fadc7765700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc0083b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:46.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.974+0000 7fadc7765700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fadc01751b0 0x7fadc016be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:46.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.974+0000 7fadc7765700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc0175590 0x7fadc0183040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:46.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.974+0000 7fadc7765700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc017d630 con 0x7fadc00ef650 2022-09-17T10:27:46.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.974+0000 7fadc7765700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc017c740 con 0x7fadc01751b0 2022-09-17T10:27:46.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.974+0000 7fadc7765700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc017ca20 con 0x7fadc0175590 2022-09-17T10:27:46.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc0083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:46.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc0083b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36824/0 (socket says 172.21.15.62:36824) 2022-09-17T10:27:46.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 -- 172.21.15.62:0/3658169529 learned_addr learned my addr 172.21.15.62:0/3658169529 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:46.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc4d00700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fadc01751b0 0x7fadc016be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:46.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5d02700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc0175590 0x7fadc0183040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:46.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 -- 172.21.15.62:0/3658169529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc0175590 msgr2=0x7fadc0183040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:46.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc0175590 0x7fadc0183040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 -- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fadc01751b0 msgr2=0x7fadc016be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:46.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fadc01751b0 0x7fadc016be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:46.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 -- 172.21.15.62:0/3658169529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0009370 con 0x7fadc00ef650 2022-09-17T10:27:46.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc5501700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc0083b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fadb800c810 tx=0x7fadb8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:46.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadbd7fa700 1 -- 172.21.15.62:0/3658169529 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8005c70 con 0x7fadc00ef650 2022-09-17T10:27:46.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadbd7fa700 1 -- 172.21.15.62:0/3658169529 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb8005dd0 con 0x7fadc00ef650 2022-09-17T10:27:46.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc017cd00 con 0x7fadc00ef650 2022-09-17T10:27:46.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadbd7fa700 1 -- 172.21.15.62:0/3658169529 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8007340 con 0x7fadc00ef650 2022-09-17T10:27:46.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.975+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc017d2c0 con 0x7fadc00ef650 2022-09-17T10:27:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.976+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc006bf40 con 0x7fadc00ef650 2022-09-17T10:27:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.977+0000 7fadbd7fa700 1 -- 172.21.15.62:0/3658169529 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fadb8010030 con 0x7fadc00ef650 2022-09-17T10:27:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.977+0000 7fadbd7fa700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fada008ba40 0x7fada008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.978+0000 7fadbd7fa700 1 -- 172.21.15.62:0/3658169529 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8713+0+0 (secure 0 0 0) 0x7fadb80b0e80 con 0x7fadc00ef650 2022-09-17T10:27:46.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.978+0000 7fadc4d00700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fada008ba40 0x7fada008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:46.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.978+0000 7fadc4d00700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fada008ba40 0x7fada008df00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fadc017daa0 tx=0x7fadb4009060).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:46.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:46.981+0000 7fadbd7fa700 1 -- 172.21.15.62:0/3658169529 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fadb8081ae0 con 0x7fadc00ef650 2022-09-17T10:27:47.200 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.198+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fadc00f0b20 con 0x7fadc00ef650 2022-09-17T10:27:47.205 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.203+0000 7fadbd7fa700 1 -- 172.21.15.62:0/3658169529 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fadb8085100 con 0x7fadc00ef650 2022-09-17T10:27:47.209 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fada008ba40 msgr2=0x7fada008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.209 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fada008ba40 0x7fada008df00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fadc017daa0 tx=0x7fadb4009060).stop 2022-09-17T10:27:47.210 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 msgr2=0x7fadc0083b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.210 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc0083b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fadb800c810 tx=0x7fadb8007f90).stop 2022-09-17T10:27:47.211 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 shutdown_connections 2022-09-17T10:27:47.211 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fada008ba40 0x7fada008df00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.212 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc0175590 0x7fadc0183040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.212 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadc00ef650 0x7fadc0083b10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 --2- 172.21.15.62:0/3658169529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fadc01751b0 0x7fadc016be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 >> 172.21.15.62:0/3658169529 conn(0x7fadc006a170 msgr2=0x7fadc00c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:47.213 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 shutdown_connections 2022-09-17T10:27:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.205+0000 7fadc7765700 1 -- 172.21.15.62:0/3658169529 wait complete. 2022-09-17T10:27:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:added data pool 5 to fsmap 2022-09-17T10:27:47.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-17T10:27:47.336 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.334+0000 7fe8d2c5c700 1 Processor -- start 2022-09-17T10:27:47.336 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.334+0000 7fe8d2c5c700 1 -- start start 2022-09-17T10:27:47.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d2c5c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe8cc174c10 0x7fe8cc174ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d2c5c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8cc17d490 0x7fe8cc17d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d2c5c700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8cc17c110 con 0x7fe8cc0635f0 2022-09-17T10:27:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d2c5c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8cc1754e0 con 0x7fe8cc17d490 2022-09-17T10:27:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d2c5c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8cc17c3f0 con 0x7fe8cc174c10 2022-09-17T10:27:47.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d11f9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8cc17d490 0x7fe8cc17d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d11f9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8cc17d490 0x7fe8cc17d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36836/0 (socket says 172.21.15.62:36836) 2022-09-17T10:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d11f9700 1 -- 172.21.15.62:0/1151997867 learned_addr learned my addr 172.21.15.62:0/1151997867 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.335+0000 7fe8d09f8700 1 --2- 172.21.15.62:0/1151997867 >> v2:172.21.15.93:3300/0 conn(0x7fe8cc174c10 0x7fe8cc174ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d11f9700 1 -- 172.21.15.62:0/1151997867 >> v2:172.21.15.93:3300/0 conn(0x7fe8cc174c10 msgr2=0x7fe8cc174ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d11f9700 1 --2- 172.21.15.62:0/1151997867 >> v2:172.21.15.93:3300/0 conn(0x7fe8cc174c10 0x7fe8cc174ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d11f9700 1 -- 172.21.15.62:0/1151997867 >> v1:172.21.15.159:6789/0 conn(0x7fe8cc0635f0 legacy=0x7fe8cc063a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d11f9700 1 -- 172.21.15.62:0/1151997867 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc17c6d0 con 0x7fe8cc17d490 2022-09-17T10:27:47.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d11f9700 1 --2- 172.21.15.62:0/1151997867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc17d490 0x7fe8cc17d900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe8cc0f4bc0 tx=0x7fe8c4009840).ready entity=mon.0 client_cookie=db17c9a60113ad35 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:47.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8cb7fe700 1 -- 172.21.15.62:0/1151997867 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c400e070 con 0x7fe8cc17d490 2022-09-17T10:27:47.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8cb7fe700 1 -- 172.21.15.62:0/1151997867 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c400ba20 con 0x7fe8cc17d490 2022-09-17T10:27:47.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8cb7fe700 1 -- 172.21.15.62:0/1151997867 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c400bda0 con 0x7fe8cc17d490 2022-09-17T10:27:47.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1151997867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc17d490 msgr2=0x7fe8cc17d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1151997867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc17d490 0x7fe8cc17d900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe8cc0f4bc0 tx=0x7fe8c4009840).stop 2022-09-17T10:27:47.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1151997867 shutdown_connections 2022-09-17T10:27:47.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1151997867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc17d490 0x7fe8cc17d900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1151997867 >> v2:172.21.15.93:3300/0 conn(0x7fe8cc174c10 0x7fe8cc174ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1151997867 >> 172.21.15.62:0/1151997867 conn(0x7fe8cc0f4c90 msgr2=0x7fe8cc0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:47.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1151997867 shutdown_connections 2022-09-17T10:27:47.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.336+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1151997867 wait complete. 2022-09-17T10:27:47.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.338+0000 7fe8d2c5c700 1 Processor -- start 2022-09-17T10:27:47.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.338+0000 7fe8d2c5c700 1 -- start start 2022-09-17T10:27:47.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d2c5c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc0635f0 0x7fe8cc1917b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d2c5c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8cc174c10 0x7fe8cc0cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d2c5c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8cc17d490 0x7fe8cc1722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d2c5c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc18e260 con 0x7fe8cc0635f0 2022-09-17T10:27:47.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d2c5c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc1926b0 con 0x7fe8cc17d490 2022-09-17T10:27:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d2c5c700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc174400 con 0x7fe8cc174c10 2022-09-17T10:27:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc0635f0 0x7fe8cc1917b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc0635f0 0x7fe8cc1917b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36840/0 (socket says 172.21.15.62:36840) 2022-09-17T10:27:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 -- 172.21.15.62:0/1421801976 learned_addr learned my addr 172.21.15.62:0/1421801976 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:47.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8cbfff700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8cc174c10 0x7fe8cc0cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 -- 172.21.15.62:0/1421801976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8cc174c10 msgr2=0x7fe8cc0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8cc174c10 0x7fe8cc0cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 -- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8cc17d490 msgr2=0x7fe8cc1722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8cc17d490 0x7fe8cc1722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:27:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 -- 172.21.15.62:0/1421801976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c4009ae0 con 0x7fe8cc0635f0 2022-09-17T10:27:47.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.339+0000 7fe8d09f8700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc0635f0 0x7fe8cc1917b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fe8c000e980 tx=0x7fe8c0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:47.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.340+0000 7fe8c8ff9700 1 -- 172.21.15.62:0/1421801976 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000c7f0 con 0x7fe8cc0635f0 2022-09-17T10:27:47.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.340+0000 7fe8c8ff9700 1 -- 172.21.15.62:0/1421801976 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000c950 con 0x7fe8cc0635f0 2022-09-17T10:27:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.340+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8cc18ea80 con 0x7fe8cc0635f0 2022-09-17T10:27:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.340+0000 7fe8c8ff9700 1 -- 172.21.15.62:0/1421801976 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000ccd0 con 0x7fe8cc0635f0 2022-09-17T10:27:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.340+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8cc1920f0 con 0x7fe8cc0635f0 2022-09-17T10:27:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.341+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8cc06bf40 con 0x7fe8cc0635f0 2022-09-17T10:27:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.342+0000 7fe8c8ff9700 1 -- 172.21.15.62:0/1421801976 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe8c0022070 con 0x7fe8cc0635f0 2022-09-17T10:27:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.342+0000 7fe8c8ff9700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe8b408ba40 0x7fe8b408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.342+0000 7fe8c8ff9700 1 -- 172.21.15.62:0/1421801976 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fe8c00b1350 con 0x7fe8cc0635f0 2022-09-17T10:27:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.342+0000 7fe8cbfff700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe8b408ba40 0x7fe8b408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.343+0000 7fe8cbfff700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe8b408ba40 0x7fe8b408df00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe8cc16ed00 tx=0x7fe8b8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:47.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.345+0000 7fe8c8ff9700 1 -- 172.21.15.62:0/1421801976 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fe8c0082010 con 0x7fe8cc0635f0 2022-09-17T10:27:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.561+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8cc17c9b0 con 0x7fe8cc0635f0 2022-09-17T10:27:47.564 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.562+0000 7fe8c8ff9700 1 -- 172.21.15.62:0/1421801976 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+10527 (secure 0 0 0) 0x7fe8c0016070 con 0x7fe8cc0635f0 2022-09-17T10:27:47.564 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:47.564 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/2161434381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2161434381},{"type":"v1","addr":"172.21.15.62:6833","nonce":2161434381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/1194163827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1194163827},{"type":"v1","addr":"172.21.15.62:6839","nonce":1194163827}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/413826247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":413826247},{"type":"v1","addr":"172.21.15.93:6835","nonce":413826247}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4325,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3152394380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3152394380},{"type":"v1","addr":"172.21.15.159:6836","nonce":3152394380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2292269070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2292269070},{"type":"v1","addr":"172.21.15.62:6835","nonce":2292269070}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4327,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/301789402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":301789402},{"type":"v1","addr":"172.21.15.93:6837","nonce":301789402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4329,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1156565194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1156565194},{"type":"v1","addr":"172.21.15.62:6837","nonce":1156565194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4333,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6839/135709201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":135709201},{"type":"v1","addr":"172.21.15.93:6839","nonce":135709201}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4336,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6841/1241271614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6840","nonce":1241271614},{"type":"v1","addr":"172.21.15.93:6841","nonce":1241271614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/426632534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":426632534},{"type":"v1","addr":"172.21.15.159:6833","nonce":426632534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4360,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/574611303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":574611303},{"type":"v1","addr":"172.21.15.159:6839","nonce":574611303}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-09-17T10:27:42.793084+0000","modified":"2022-09-17T10:27:47.200107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/802951039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":802951039},{"type":"v1","addr":"172.21.15.159:6837","nonce":802951039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-09-17T10:27:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.563+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe8b408ba40 msgr2=0x7fe8b408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.563+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe8b408ba40 0x7fe8b408df00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe8cc16ed00 tx=0x7fe8b8009040).stop 2022-09-17T10:27:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc0635f0 msgr2=0x7fe8cc1917b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc0635f0 0x7fe8cc1917b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fe8c000e980 tx=0x7fe8c0009060).stop 2022-09-17T10:27:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 shutdown_connections 2022-09-17T10:27:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe8b408ba40 0x7fe8b408df00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8cc17d490 0x7fe8cc1722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:27:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8cc0635f0 0x7fe8cc1917b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 --2- 172.21.15.62:0/1421801976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8cc174c10 0x7fe8cc0cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.568 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 >> 172.21.15.62:0/1421801976 conn(0x7fe8cc0f4c90 msgr2=0x7fe8cc164f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:47.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 shutdown_connections 2022-09-17T10:27:47.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.564+0000 7fe8d2c5c700 1 -- 172.21.15.62:0/1421801976 wait complete. 2022-09-17T10:27:47.569 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2022-09-17T10:27:47.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.693+0000 7f52389fe700 1 Processor -- start 2022-09-17T10:27:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.693+0000 7f52389fe700 1 -- start start 2022-09-17T10:27:47.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f52389fe700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52340e60d0 con 0x7f5234174bb0 2022-09-17T10:27:47.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f52389fe700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52340e5880 con 0x7f52340e5400 2022-09-17T10:27:47.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f52389fe700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523417f850 con 0x7f5234180a00 2022-09-17T10:27:47.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f5232d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5234174bb0 0x7f52340e4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58892/0 (socket says 172.21.15.62:58892) 2022-09-17T10:27:47.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f5232d9d700 1 -- 172.21.15.62:0/3775853159 learned_addr learned my addr 172.21.15.62:0/3775853159 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:47.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592766482 0 0) 0x7f52340e60d0 con 0x7f5234174bb0 2022-09-17T10:27:47.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52200033f0 con 0x7f5234174bb0 2022-09-17T10:27:47.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279561808 0 0) 0x7f52200033f0 con 0x7f5234174bb0 2022-09-17T10:27:47.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.694+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 >> v1:172.21.15.159:6789/0 conn(0x7f5234180a00 legacy=0x7f523417e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 >> v1:172.21.15.93:6789/0 conn(0x7f52340e5400 legacy=0x7f52341802f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340e5b10 con 0x7f5234174bb0 2022-09-17T10:27:47.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f5224001470 con 0x7f5234174bb0 2022-09-17T10:27:47.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 >> v1:172.21.15.62:6789/0 conn(0x7f5234174bb0 legacy=0x7f52340e4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5220003960 0x7f5220003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5220004690 0x7f5220004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52200051b0 0x7f522000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522000c100 con 0x7f5220003960 2022-09-17T10:27:47.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522000c270 con 0x7f5220004690 2022-09-17T10:27:47.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522000c430 con 0x7f52200051b0 2022-09-17T10:27:47.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5232d9d700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5220003960 0x7f5220003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f523259c700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5220004690 0x7f5220004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f523359e700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52200051b0 0x7f522000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5232d9d700 1 -- 172.21.15.62:0/3775853159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52200051b0 msgr2=0x7f522000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:47.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5232d9d700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52200051b0 0x7f522000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5232d9d700 1 -- 172.21.15.62:0/3775853159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5220004690 msgr2=0x7f5220004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:47.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5232d9d700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5220004690 0x7f5220004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5232d9d700 1 -- 172.21.15.62:0/3775853159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200033f0 con 0x7f5220003960 2022-09-17T10:27:47.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f523359e700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52200051b0 0x7f522000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:47.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f523359e700 1 -- 172.21.15.62:0/3775853159 reap_dead start 2022-09-17T10:27:47.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5232d9d700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5220003960 0x7f5220003d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f522400c190 tx=0x7f5224001e10).ready entity=mon.0 client_cookie=f30ed3efd8c0ded4 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:47.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224007960 con 0x7f5220003960 2022-09-17T10:27:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522400ca60 con 0x7f5220003960 2022-09-17T10:27:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.695+0000 7f5231d9b700 1 -- 172.21.15.62:0/3775853159 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400cde0 con 0x7f5220003960 2022-09-17T10:27:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.696+0000 7f52389fe700 1 -- 172.21.15.62:0/3775853159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5220003960 msgr2=0x7f5220003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.696+0000 7f52389fe700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5220003960 0x7f5220003d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f522400c190 tx=0x7f5224001e10).stop 2022-09-17T10:27:47.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.696+0000 7f52389fe700 1 -- 172.21.15.62:0/3775853159 shutdown_connections 2022-09-17T10:27:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.696+0000 7f52389fe700 1 --2- 172.21.15.62:0/3775853159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5220003960 0x7f5220003d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.696+0000 7f52389fe700 1 -- 172.21.15.62:0/3775853159 >> 172.21.15.62:0/3775853159 conn(0x7f52340e2570 msgr2=0x7f52340e0620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:47.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.696+0000 7f52389fe700 1 -- 172.21.15.62:0/3775853159 shutdown_connections 2022-09-17T10:27:47.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.696+0000 7f52389fe700 1 -- 172.21.15.62:0/3775853159 wait complete. 2022-09-17T10:27:47.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.697+0000 7f52389fe700 1 Processor -- start 2022-09-17T10:27:47.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.697+0000 7f52389fe700 1 -- start start 2022-09-17T10:27:47.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.698+0000 7f52389fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5220003960 0x7f5234181e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.698+0000 7f52389fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523416d3e0 0x7f523416d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f52389fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52340ba380 0x7f52340ba800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f52389fe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52340b9ef0 con 0x7f523416d3e0 2022-09-17T10:27:47.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f52389fe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52340b9630 con 0x7f52340ba380 2022-09-17T10:27:47.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f52389fe700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5234179980 con 0x7f5220003960 2022-09-17T10:27:47.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523416d3e0 0x7f523416d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523416d3e0 0x7f523416d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36856/0 (socket says 172.21.15.62:36856) 2022-09-17T10:27:47.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 -- 172.21.15.62:0/3747160845 learned_addr learned my addr 172.21.15.62:0/3747160845 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:47.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f5232d9d700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5220003960 0x7f5234181e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523359e700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52340ba380 0x7f52340ba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 -- 172.21.15.62:0/3747160845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5220003960 msgr2=0x7f5234181e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5220003960 0x7f5234181e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 -- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52340ba380 msgr2=0x7f52340ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52340ba380 0x7f52340ba800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 -- 172.21.15.62:0/3747160845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340b98a0 con 0x7f523416d3e0 2022-09-17T10:27:47.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f523259c700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523416d3e0 0x7f523416d860 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f52280028f0 tx=0x7f5228007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:47.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f521affd700 1 -- 172.21.15.62:0/3747160845 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228003350 con 0x7f523416d3e0 2022-09-17T10:27:47.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f521affd700 1 -- 172.21.15.62:0/3747160845 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800f670 con 0x7f523416d3e0 2022-09-17T10:27:47.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52340b9b80 con 0x7f523416d3e0 2022-09-17T10:27:47.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f521affd700 1 -- 172.21.15.62:0/3747160845 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800f9f0 con 0x7f523416d3e0 2022-09-17T10:27:47.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.699+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5234182340 con 0x7f523416d3e0 2022-09-17T10:27:47.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.700+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523406be90 con 0x7f523416d3e0 2022-09-17T10:27:47.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.701+0000 7f521affd700 1 -- 172.21.15.62:0/3747160845 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f522801b030 con 0x7f523416d3e0 2022-09-17T10:27:47.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.701+0000 7f521affd700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f521408ba40 0x7f521408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:47.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.702+0000 7f521affd700 1 -- 172.21.15.62:0/3747160845 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f52280b0430 con 0x7f523416d3e0 2022-09-17T10:27:47.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.702+0000 7f5232d9d700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f521408ba40 0x7f521408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:47.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.702+0000 7f5232d9d700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f521408ba40 0x7f521408df00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5224001e70 tx=0x7f5224015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:47.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.705+0000 7f521affd700 1 -- 172.21.15.62:0/3747160845 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f52280810f0 con 0x7f523416d3e0 2022-09-17T10:27:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.878+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52340e5df0 con 0x7f523416d3e0 2022-09-17T10:27:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.880+0000 7f521affd700 1 -- 172.21.15.62:0/3747160845 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7f5228019030 con 0x7f523416d3e0 2022-09-17T10:27:47.882 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:47.882 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:47.884 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f521408ba40 msgr2=0x7f521408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.884 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f521408ba40 0x7f521408df00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5224001e70 tx=0x7f5224015000).stop 2022-09-17T10:27:47.884 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523416d3e0 msgr2=0x7f523416d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:47.884 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523416d3e0 0x7f523416d860 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f52280028f0 tx=0x7f5228007bb0).stop 2022-09-17T10:27:47.885 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 shutdown_connections 2022-09-17T10:27:47.885 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f521408ba40 0x7f521408df00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.885 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52340ba380 0x7f52340ba800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.885 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5220003960 0x7f5234181e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.886 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 --2- 172.21.15.62:0/3747160845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523416d3e0 0x7f523416d860 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:47.886 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 >> 172.21.15.62:0/3747160845 conn(0x7f52340e2570 msgr2=0x7f52340eba00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:47.886 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 shutdown_connections 2022-09-17T10:27:47.886 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:47.881+0000 7f52389fe700 1 -- 172.21.15.62:0/3747160845 wait complete. 2022-09-17T10:27:47.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:48.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.013+0000 7f65d3f89700 1 Processor -- start 2022-09-17T10:27:48.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.013+0000 7f65d3f89700 1 -- start start 2022-09-17T10:27:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d3f89700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65cc1751b0 0x7f65cc180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d3f89700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65cc175590 0x7f65cc180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d3f89700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f65cc181050 0x7f65cc181dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d3f89700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0f10e0 con 0x7f65cc175590 2022-09-17T10:27:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d3f89700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0c6dd0 con 0x7f65cc1751b0 2022-09-17T10:27:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d3f89700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc1801e0 con 0x7f65cc181050 2022-09-17T10:27:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65cc175590 0x7f65cc180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65cc175590 0x7f65cc180b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36870/0 (socket says 172.21.15.62:36870) 2022-09-17T10:27:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 -- 172.21.15.62:0/571610628 learned_addr learned my addr 172.21.15.62:0/571610628 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d2526700 1 --2- 172.21.15.62:0/571610628 >> v2:172.21.15.159:3300/0 conn(0x7f65cc181050 0x7f65cc181dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1d25700 1 --2- 172.21.15.62:0/571610628 >> v2:172.21.15.93:3300/0 conn(0x7f65cc1751b0 0x7f65cc180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 -- 172.21.15.62:0/571610628 >> v2:172.21.15.159:3300/0 conn(0x7f65cc181050 msgr2=0x7f65cc181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 --2- 172.21.15.62:0/571610628 >> v2:172.21.15.159:3300/0 conn(0x7f65cc181050 0x7f65cc181dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 -- 172.21.15.62:0/571610628 >> v2:172.21.15.93:3300/0 conn(0x7f65cc1751b0 msgr2=0x7f65cc180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 --2- 172.21.15.62:0/571610628 >> v2:172.21.15.93:3300/0 conn(0x7f65cc1751b0 0x7f65cc180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 -- 172.21.15.62:0/571610628 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0f0840 con 0x7f65cc175590 2022-09-17T10:27:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1d25700 1 --2- 172.21.15.62:0/571610628 >> v2:172.21.15.93:3300/0 conn(0x7f65cc1751b0 0x7f65cc180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:48.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.014+0000 7f65d1524700 1 --2- 172.21.15.62:0/571610628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc175590 0x7f65cc180b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f65cc088880 tx=0x7f65c00090f0).ready entity=mon.0 client_cookie=a67ed4f387a4e0dc server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d0d23700 1 -- 172.21.15.62:0/571610628 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000b600 con 0x7f65cc175590 2022-09-17T10:27:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d0d23700 1 -- 172.21.15.62:0/571610628 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c000b760 con 0x7f65cc175590 2022-09-17T10:27:48.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d0d23700 1 -- 172.21.15.62:0/571610628 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000bb00 con 0x7f65cc175590 2022-09-17T10:27:48.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 -- 172.21.15.62:0/571610628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc175590 msgr2=0x7f65cc180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 --2- 172.21.15.62:0/571610628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc175590 0x7f65cc180b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f65cc088880 tx=0x7f65c00090f0).stop 2022-09-17T10:27:48.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 -- 172.21.15.62:0/571610628 shutdown_connections 2022-09-17T10:27:48.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 --2- 172.21.15.62:0/571610628 >> v2:172.21.15.159:3300/0 conn(0x7f65cc181050 0x7f65cc181dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 --2- 172.21.15.62:0/571610628 >> v2:172.21.15.93:3300/0 conn(0x7f65cc1751b0 0x7f65cc180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 --2- 172.21.15.62:0/571610628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc175590 0x7f65cc180b60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 -- 172.21.15.62:0/571610628 >> 172.21.15.62:0/571610628 conn(0x7f65cc06a170 msgr2=0x7f65cc0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:48.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 -- 172.21.15.62:0/571610628 shutdown_connections 2022-09-17T10:27:48.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.015+0000 7f65d3f89700 1 -- 172.21.15.62:0/571610628 wait complete. 2022-09-17T10:27:48.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.017+0000 7f65d3f89700 1 Processor -- start 2022-09-17T10:27:48.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.017+0000 7f65d3f89700 1 -- start start 2022-09-17T10:27:48.031 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d3f89700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65cc1751b0 0x7f65cc086640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.032 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d3f89700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65cc175590 0x7f65cc086b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.032 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d3f89700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc181050 0x7f65cc16d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.032 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d3f89700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0861b0 con 0x7f65cc181050 2022-09-17T10:27:48.032 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d3f89700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0858c0 con 0x7f65cc1751b0 2022-09-17T10:27:48.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d3f89700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc17d7e0 con 0x7f65cc175590 2022-09-17T10:27:48.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc181050 0x7f65cc16d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc181050 0x7f65cc16d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36876/0 (socket says 172.21.15.62:36876) 2022-09-17T10:27:48.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 -- 172.21.15.62:0/1016252217 learned_addr learned my addr 172.21.15.62:0/1016252217 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:48.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d1524700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65cc175590 0x7f65cc086b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d1d25700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65cc1751b0 0x7f65cc086640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 -- 172.21.15.62:0/1016252217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65cc175590 msgr2=0x7f65cc086b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65cc175590 0x7f65cc086b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 -- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65cc1751b0 msgr2=0x7f65cc086640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65cc1751b0 0x7f65cc086640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 -- 172.21.15.62:0/1016252217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c0009370 con 0x7f65cc181050 2022-09-17T10:27:48.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d1524700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65cc175590 0x7f65cc086b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:48.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d1d25700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65cc1751b0 0x7f65cc086640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:48.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d2526700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc181050 0x7f65cc16d490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f65bc00bfd0 tx=0x7f65bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:48.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65c9ffb700 1 -- 172.21.15.62:0/1016252217 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc011590 con 0x7f65cc181050 2022-09-17T10:27:48.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65c9ffb700 1 -- 172.21.15.62:0/1016252217 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc0116f0 con 0x7f65cc181050 2022-09-17T10:27:48.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc085b60 con 0x7f65cc181050 2022-09-17T10:27:48.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.018+0000 7f65c9ffb700 1 -- 172.21.15.62:0/1016252217 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc011a70 con 0x7f65cc181050 2022-09-17T10:27:48.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.019+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc17dac0 con 0x7f65cc181050 2022-09-17T10:27:48.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.019+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc086320 con 0x7f65cc181050 2022-09-17T10:27:48.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.020+0000 7f65c9ffb700 1 -- 172.21.15.62:0/1016252217 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f65bc01c460 con 0x7f65cc181050 2022-09-17T10:27:48.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.021+0000 7f65c9ffb700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f65ac08ba40 0x7f65ac08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.021+0000 7f65c9ffb700 1 -- 172.21.15.62:0/1016252217 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f65bc0b08c0 con 0x7f65cc181050 2022-09-17T10:27:48.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.021+0000 7f65d1d25700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f65ac08ba40 0x7f65ac08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.022+0000 7f65d1d25700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f65ac08ba40 0x7f65ac08df00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f65c400d640 tx=0x7f65c4007670).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:48.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.025+0000 7f65c9ffb700 1 -- 172.21.15.62:0/1016252217 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f65bc081500 con 0x7f65cc181050 2022-09-17T10:27:48.201 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.200+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65cc06bf40 con 0x7f65cc181050 2022-09-17T10:27:48.203 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.201+0000 7f65c9ffb700 1 -- 172.21.15.62:0/1016252217 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7f65bc084b20 con 0x7f65cc181050 2022-09-17T10:27:48.203 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:48.204 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:48.206 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f65ac08ba40 msgr2=0x7f65ac08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.207 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f65ac08ba40 0x7f65ac08df00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f65c400d640 tx=0x7f65c4007670).stop 2022-09-17T10:27:48.207 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc181050 msgr2=0x7f65cc16d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.207 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc181050 0x7f65cc16d490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f65bc00bfd0 tx=0x7f65bc008040).stop 2022-09-17T10:27:48.208 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 shutdown_connections 2022-09-17T10:27:48.208 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f65ac08ba40 0x7f65ac08df00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.209 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65cc1751b0 0x7f65cc086640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.209 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65cc181050 0x7f65cc16d490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.210 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 --2- 172.21.15.62:0/1016252217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65cc175590 0x7f65cc086b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.210 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 >> 172.21.15.62:0/1016252217 conn(0x7f65cc06a170 msgr2=0x7f65cc1808f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:48.211 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 shutdown_connections 2022-09-17T10:27:48.211 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.203+0000 7f65d3f89700 1 -- 172.21.15.62:0/1016252217 wait complete. 2022-09-17T10:27:48.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-17T10:27:48.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.353+0000 7fb17a2b3700 1 Processor -- start 2022-09-17T10:27:48.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.353+0000 7fb17a2b3700 1 -- start start 2022-09-17T10:27:48.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb17a2b3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1741762d0 0x7fb1741766b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb17a2b3700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb1740c4510 0x7fb17417e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb17a2b3700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17417da40 con 0x7fb17417ecb0 2022-09-17T10:27:48.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb17a2b3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb174085d90 con 0x7fb1741762d0 2022-09-17T10:27:48.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb17a2b3700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb174086070 con 0x7fb1740c4510 2022-09-17T10:27:48.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb173fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1741762d0 0x7fb1741766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb173fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1741762d0 0x7fb1741766b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36884/0 (socket says 172.21.15.62:36884) 2022-09-17T10:27:48.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb173fff700 1 -- 172.21.15.62:0/2795937164 learned_addr learned my addr 172.21.15.62:0/2795937164 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:48.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb1737fe700 1 --2- 172.21.15.62:0/2795937164 >> v2:172.21.15.159:3300/0 conn(0x7fb1740c4510 0x7fb17417e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb173fff700 1 -- 172.21.15.62:0/2795937164 >> v2:172.21.15.159:3300/0 conn(0x7fb1740c4510 msgr2=0x7fb17417e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:48.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb173fff700 1 --2- 172.21.15.62:0/2795937164 >> v2:172.21.15.159:3300/0 conn(0x7fb1740c4510 0x7fb17417e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb173fff700 1 -- 172.21.15.62:0/2795937164 >> v1:172.21.15.93:6789/0 conn(0x7fb17417ecb0 legacy=0x7fb17417fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb173fff700 1 -- 172.21.15.62:0/2795937164 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17417dce0 con 0x7fb1741762d0 2022-09-17T10:27:48.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb173fff700 1 --2- 172.21.15.62:0/2795937164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb1741766b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fb1740c8250 tx=0x7fb1640090f0).ready entity=mon.0 client_cookie=581359e3dc9908d9 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:48.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb172ffd700 1 -- 172.21.15.62:0/2795937164 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400b600 con 0x7fb1741762d0 2022-09-17T10:27:48.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb172ffd700 1 -- 172.21.15.62:0/2795937164 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16400b760 con 0x7fb1741762d0 2022-09-17T10:27:48.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.354+0000 7fb172ffd700 1 -- 172.21.15.62:0/2795937164 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400bae0 con 0x7fb1741762d0 2022-09-17T10:27:48.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.355+0000 7fb17a2b3700 1 -- 172.21.15.62:0/2795937164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 msgr2=0x7fb1741766b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.355+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/2795937164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb1741766b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fb1740c8250 tx=0x7fb1640090f0).stop 2022-09-17T10:27:48.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.355+0000 7fb17a2b3700 1 -- 172.21.15.62:0/2795937164 shutdown_connections 2022-09-17T10:27:48.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.355+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/2795937164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb1741766b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.355+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/2795937164 >> v2:172.21.15.159:3300/0 conn(0x7fb1740c4510 0x7fb17417e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.355+0000 7fb17a2b3700 1 -- 172.21.15.62:0/2795937164 >> 172.21.15.62:0/2795937164 conn(0x7fb1740f2aa0 msgr2=0x7fb1740f2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:48.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.355+0000 7fb17a2b3700 1 -- 172.21.15.62:0/2795937164 shutdown_connections 2022-09-17T10:27:48.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.355+0000 7fb17a2b3700 1 -- 172.21.15.62:0/2795937164 wait complete. 2022-09-17T10:27:48.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.356+0000 7fb17a2b3700 1 Processor -- start 2022-09-17T10:27:48.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.357+0000 7fb17a2b3700 1 -- start start 2022-09-17T10:27:48.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.357+0000 7fb17a2b3700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1740c4510 0x7fb17416afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.357+0000 7fb17a2b3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb17418f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.357+0000 7fb17a2b3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb17417ecb0 0x7fb17418f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.357+0000 7fb17a2b3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb174177560 con 0x7fb1741762d0 2022-09-17T10:27:48.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.357+0000 7fb17a2b3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17418fa20 con 0x7fb17417ecb0 2022-09-17T10:27:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.357+0000 7fb17a2b3700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740ecb50 con 0x7fb1740c4510 2022-09-17T10:27:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb17418f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb17418f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36890/0 (socket says 172.21.15.62:36890) 2022-09-17T10:27:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 -- 172.21.15.62:0/707872711 learned_addr learned my addr 172.21.15.62:0/707872711 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb173fff700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1740c4510 0x7fb17416afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb178850700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb17417ecb0 0x7fb17418f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 -- 172.21.15.62:0/707872711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1740c4510 msgr2=0x7fb17416afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1740c4510 0x7fb17416afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 -- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb17417ecb0 msgr2=0x7fb17418f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb17417ecb0 0x7fb17418f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 -- 172.21.15.62:0/707872711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164009370 con 0x7fb1741762d0 2022-09-17T10:27:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb1737fe700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb17418f040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb15c00d860 tx=0x7fb15c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb16bfff700 1 -- 172.21.15.62:0/707872711 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c011590 con 0x7fb1741762d0 2022-09-17T10:27:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb16bfff700 1 -- 172.21.15.62:0/707872711 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c0116f0 con 0x7fb1741762d0 2022-09-17T10:27:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1740ece30 con 0x7fb1741762d0 2022-09-17T10:27:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb16bfff700 1 -- 172.21.15.62:0/707872711 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c011a70 con 0x7fb1741762d0 2022-09-17T10:27:48.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.358+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb174176f10 con 0x7fb1741762d0 2022-09-17T10:27:48.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.359+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17406bf40 con 0x7fb1741762d0 2022-09-17T10:27:48.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.360+0000 7fb16bfff700 1 -- 172.21.15.62:0/707872711 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb15c01c460 con 0x7fb1741762d0 2022-09-17T10:27:48.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.360+0000 7fb16bfff700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb15808ba40 0x7fb15808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:48.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.360+0000 7fb16bfff700 1 -- 172.21.15.62:0/707872711 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb15c0b0690 con 0x7fb1741762d0 2022-09-17T10:27:48.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.361+0000 7fb173fff700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb15808ba40 0x7fb15808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:48.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.361+0000 7fb173fff700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb15808ba40 0x7fb15808df00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb164009130 tx=0x7fb164017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:48.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.364+0000 7fb16bfff700 1 -- 172.21.15.62:0/707872711 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fb15c081350 con 0x7fb1741762d0 2022-09-17T10:27:48.582 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.580+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb17417dfc0 con 0x7fb1741762d0 2022-09-17T10:27:48.584 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.581+0000 7fb16bfff700 1 -- 172.21.15.62:0/707872711 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+10527 (secure 0 0 0) 0x7fb15c011e60 con 0x7fb1741762d0 2022-09-17T10:27:48.584 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:48.585 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/2161434381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2161434381},{"type":"v1","addr":"172.21.15.62:6833","nonce":2161434381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/1194163827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1194163827},{"type":"v1","addr":"172.21.15.62:6839","nonce":1194163827}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/413826247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":413826247},{"type":"v1","addr":"172.21.15.93:6835","nonce":413826247}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4325,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3152394380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3152394380},{"type":"v1","addr":"172.21.15.159:6836","nonce":3152394380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2292269070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2292269070},{"type":"v1","addr":"172.21.15.62:6835","nonce":2292269070}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4327,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/301789402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":301789402},{"type":"v1","addr":"172.21.15.93:6837","nonce":301789402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4329,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1156565194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1156565194},{"type":"v1","addr":"172.21.15.62:6837","nonce":1156565194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4333,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6839/135709201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":135709201},{"type":"v1","addr":"172.21.15.93:6839","nonce":135709201}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4336,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6841/1241271614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6840","nonce":1241271614},{"type":"v1","addr":"172.21.15.93:6841","nonce":1241271614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/426632534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":426632534},{"type":"v1","addr":"172.21.15.159:6833","nonce":426632534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4360,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/574611303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":574611303},{"type":"v1","addr":"172.21.15.159:6839","nonce":574611303}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-09-17T10:27:42.793084+0000","modified":"2022-09-17T10:27:47.200107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/802951039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":802951039},{"type":"v1","addr":"172.21.15.159:6837","nonce":802951039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-09-17T10:27:48.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb15808ba40 msgr2=0x7fb15808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb15808ba40 0x7fb15808df00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb164009130 tx=0x7fb164017000).stop 2022-09-17T10:27:48.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 msgr2=0x7fb17418f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:48.589 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb17418f040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb15c00d860 tx=0x7fb15c008040).stop 2022-09-17T10:27:48.589 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 shutdown_connections 2022-09-17T10:27:48.590 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb15808ba40 0x7fb15808df00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.590 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb17417ecb0 0x7fb17418f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.591 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1740c4510 0x7fb17416afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.591 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 --2- 172.21.15.62:0/707872711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1741762d0 0x7fb17418f040 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:48.592 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 >> 172.21.15.62:0/707872711 conn(0x7fb1740f2aa0 msgr2=0x7fb17416c720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:48.592 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 shutdown_connections 2022-09-17T10:27:48.592 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:48.583+0000 7fb17a2b3700 1 -- 172.21.15.62:0/707872711 wait complete. 2022-09-17T10:27:48.593 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2022-09-17T10:27:49.807 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-09-17T10:27:42.793084+0000', 'modified': '2022-09-17T10:27:47.200107+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4365': {'gid': 4365, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6837/802951039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6835', 'nonce': 802951039}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 802951039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2022-09-17T10:27:49.807 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-09-17T10:27:49.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-09-17T10:27:49.941 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.939+0000 7f6d37fff700 1 Processor -- start 2022-09-17T10:27:49.941 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.939+0000 7f6d37fff700 1 -- start start 2022-09-17T10:27:49.945 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.940+0000 7f6d37fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d3817dcd0 0x7f6d3817e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.945 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.940+0000 7f6d37fff700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380e50a0 con 0x7f6d3817ebf0 2022-09-17T10:27:49.945 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.940+0000 7f6d37fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380eb330 con 0x7f6d3817f070 2022-09-17T10:27:49.946 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.940+0000 7f6d37fff700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380eb860 con 0x7f6d3817dcd0 2022-09-17T10:27:49.946 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.940+0000 7f6d377fe700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f6d3817f070 0x7f6d380ebc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.62:52464/0 (socket says 172.21.15.62:52464) 2022-09-17T10:27:49.946 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.940+0000 7f6d377fe700 1 -- 172.21.15.62:0/3225417399 learned_addr learned my addr 172.21.15.62:0/3225417399 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:49.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.940+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/3225417399 >> v2:172.21.15.93:3300/0 conn(0x7f6d3817dcd0 0x7f6d3817e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d35ffb700 1 -- 172.21.15.62:0/3225417399 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637285118 0 0) 0x7f6d380eb330 con 0x7f6d3817f070 2022-09-17T10:27:49.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d35ffb700 1 -- 172.21.15.62:0/3225417399 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d240033f0 con 0x7f6d3817f070 2022-09-17T10:27:49.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d36ffd700 1 -- 172.21.15.62:0/3225417399 >> v1:172.21.15.159:6789/0 conn(0x7f6d3817f070 legacy=0x7f6d380ebc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:49.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d36ffd700 1 -- 172.21.15.62:0/3225417399 >> v1:172.21.15.93:6789/0 conn(0x7f6d3817ebf0 legacy=0x7f6d380e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:49.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d35ffb700 1 -- 172.21.15.62:0/3225417399 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798578433 0 0) 0x7f6d380e50a0 con 0x7f6d3817ebf0 2022-09-17T10:27:49.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d36ffd700 1 -- 172.21.15.62:0/3225417399 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3817f4e0 con 0x7f6d3817dcd0 2022-09-17T10:27:49.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/3225417399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817dcd0 0x7f6d3817e0b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6d28009760 tx=0x7f6d28009060).ready entity=mon.1 client_cookie=cb61079f70f633b6 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:49.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d35ffb700 1 -- 172.21.15.62:0/3225417399 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280090d0 con 0x7f6d3817dcd0 2022-09-17T10:27:49.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d35ffb700 1 -- 172.21.15.62:0/3225417399 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2800f510 con 0x7f6d3817dcd0 2022-09-17T10:27:49.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d35ffb700 1 -- 172.21.15.62:0/3225417399 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800f890 con 0x7f6d3817dcd0 2022-09-17T10:27:49.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d37fff700 1 -- 172.21.15.62:0/3225417399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817dcd0 msgr2=0x7f6d3817e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:49.950 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.941+0000 7f6d37fff700 1 --2- 172.21.15.62:0/3225417399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817dcd0 0x7f6d3817e0b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6d28009760 tx=0x7f6d28009060).stop 2022-09-17T10:27:49.950 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.942+0000 7f6d37fff700 1 -- 172.21.15.62:0/3225417399 shutdown_connections 2022-09-17T10:27:49.950 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.942+0000 7f6d37fff700 1 --2- 172.21.15.62:0/3225417399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817dcd0 0x7f6d3817e0b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.950 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.942+0000 7f6d37fff700 1 -- 172.21.15.62:0/3225417399 >> 172.21.15.62:0/3225417399 conn(0x7f6d380de5f0 msgr2=0x7f6d3805d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:49.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.942+0000 7f6d37fff700 1 -- 172.21.15.62:0/3225417399 shutdown_connections 2022-09-17T10:27:49.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.942+0000 7f6d37fff700 1 -- 172.21.15.62:0/3225417399 wait complete. 2022-09-17T10:27:49.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.943+0000 7f6d37fff700 1 Processor -- start 2022-09-17T10:27:49.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.943+0000 7f6d37fff700 1 -- start start 2022-09-17T10:27:49.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3817dcd0 0x7f6d3818fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3817ebf0 0x7f6d3817fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817f070 0x7f6d381927a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d37fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38191190 con 0x7f6d3817ebf0 2022-09-17T10:27:49.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d37fff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38180060 con 0x7f6d3817f070 2022-09-17T10:27:49.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d37fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d381902a0 con 0x7f6d3817dcd0 2022-09-17T10:27:49.963 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3817ebf0 0x7f6d3817fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3817ebf0 0x7f6d3817fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36896/0 (socket says 172.21.15.62:36896) 2022-09-17T10:27:49.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.944+0000 7f6d367fc700 1 -- 172.21.15.62:0/872708444 learned_addr learned my addr 172.21.15.62:0/872708444 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:49.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3817dcd0 0x7f6d3818fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d377fe700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817f070 0x7f6d381927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d367fc700 1 -- 172.21.15.62:0/872708444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3817dcd0 msgr2=0x7f6d3818fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:49.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d367fc700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3817dcd0 0x7f6d3818fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d367fc700 1 -- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817f070 msgr2=0x7f6d381927a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:49.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d367fc700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817f070 0x7f6d381927a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d367fc700 1 -- 172.21.15.62:0/872708444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280092a0 con 0x7f6d3817ebf0 2022-09-17T10:27:49.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d367fc700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3817ebf0 0x7f6d3817fb70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6d2c00c410 tx=0x7f6d2c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:49.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d1effd700 1 -- 172.21.15.62:0/872708444 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c007020 con 0x7f6d3817ebf0 2022-09-17T10:27:49.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d1effd700 1 -- 172.21.15.62:0/872708444 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0071a0 con 0x7f6d3817ebf0 2022-09-17T10:27:49.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d37fff700 1 -- 172.21.15.62:0/872708444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d38190580 con 0x7f6d3817ebf0 2022-09-17T10:27:49.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d1effd700 1 -- 172.21.15.62:0/872708444 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c007560 con 0x7f6d3817ebf0 2022-09-17T10:27:49.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.945+0000 7f6d37fff700 1 -- 172.21.15.62:0/872708444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d38190b40 con 0x7f6d3817ebf0 2022-09-17T10:27:49.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.947+0000 7f6d1effd700 1 -- 172.21.15.62:0/872708444 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6d2c010070 con 0x7f6d3817ebf0 2022-09-17T10:27:49.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.947+0000 7f6d1effd700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6d1808ba40 0x7f6d1808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.948+0000 7f6d1effd700 1 -- 172.21.15.62:0/872708444 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6d2c0afa10 con 0x7f6d3817ebf0 2022-09-17T10:27:49.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.948+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6d1808ba40 0x7f6d1808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.948+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6d1808ba40 0x7f6d1808df00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6d28009760 tx=0x7f6d28017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:49.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.949+0000 7f6d4eedbb80 1 Processor -- start 2022-09-17T10:27:49.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.949+0000 7f6d4eedbb80 1 -- start start 2022-09-17T10:27:49.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120836d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d212089f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d21208a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211f83a50 con 0x55d2120b6d50 2022-09-17T10:27:49.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211f98900 con 0x55d2120b71d0 2022-09-17T10:27:49.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211f600d0 con 0x55d2120832f0 2022-09-17T10:27:49.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d212089f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d212089f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36900/0 (socket says 172.21.15.62:36900) 2022-09-17T10:27:49.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.950+0000 7f6d367fc700 1 -- 172.21.15.62:0/107877127 learned_addr learned my addr 172.21.15.62:0/107877127 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:49.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120836d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d377fe700 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d21208a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d367fc700 1 -- 172.21.15.62:0/107877127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 msgr2=0x55d2120836d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:49.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d367fc700 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120836d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d367fc700 1 -- 172.21.15.62:0/107877127 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 msgr2=0x55d21208a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:49.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d367fc700 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d21208a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d367fc700 1 -- 172.21.15.62:0/107877127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d212018f70 con 0x55d2120b6d50 2022-09-17T10:27:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d377fe700 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d21208a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d367fc700 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d212089f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f6d2c084000 tx=0x7f6d2c007f20).ready entity=mon.0 client_cookie=cfbe38bd6408c4dc server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d13fff700 1 -- 172.21.15.62:0/107877127 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c089c70 con 0x55d2120b6d50 2022-09-17T10:27:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d13fff700 1 -- 172.21.15.62:0/107877127 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c082730 con 0x55d2120b6d50 2022-09-17T10:27:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d13fff700 1 -- 172.21.15.62:0/107877127 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c083880 con 0x55d2120b6d50 2022-09-17T10:27:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/107877127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 msgr2=0x55d212089f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.951+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d212089f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f6d2c084000 tx=0x7f6d2c007f20).stop 2022-09-17T10:27:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.952+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/107877127 shutdown_connections 2022-09-17T10:27:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.952+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d21208a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.952+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120836d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.952+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/107877127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d212089f20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.952+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/107877127 >> 172.21.15.62:0/107877127 conn(0x55d212046a70 msgr2=0x55d212047460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.952+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/107877127 shutdown_connections 2022-09-17T10:27:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.952+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/107877127 wait complete. 2022-09-17T10:27:49.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.952+0000 7f6d4eedbb80 1 -- start start 2022-09-17T10:27:49.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.953+0000 7f6d4eedbb80 1 Processor -- start 2022-09-17T10:27:49.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120786c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d21208eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d2120920f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2120c7260 con 0x55d2120b6d50 2022-09-17T10:27:49.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21208cc80 con 0x55d2120b71d0 2022-09-17T10:27:49.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d212091c60 con 0x55d2120832f0 2022-09-17T10:27:49.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d4eedbb80 10 client.0 ll_register_callbacks cb 0x55d212006520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-17T10:27:49.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d21208eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d21208eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36910/0 (socket says 172.21.15.62:36910) 2022-09-17T10:27:49.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 -- 172.21.15.62:0/3706202458 learned_addr learned my addr 172.21.15.62:0/3706202458 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:49.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d377fe700 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d2120920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 -- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 msgr2=0x55d2120786c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:49.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120786c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 -- 172.21.15.62:0/3706202458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 msgr2=0x55d2120920f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:49.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d2120920f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 -- 172.21.15.62:0/3706202458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d38190b40 con 0x55d2120b6d50 2022-09-17T10:27:49.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120786c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:49.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d367fc700 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d21208eb80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6d2c0076c0 tx=0x7f6d2c052000).ready entity=mon.0 client_cookie=d0fdb5573d2598a8 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:49.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d117fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2022-09-17T10:27:49.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d117fa700 1 -- 172.21.15.62:0/3706202458 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c083880 con 0x55d2120b6d50 2022-09-17T10:27:49.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d117fa700 1 -- 172.21.15.62:0/3706202458 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6d2c089c70 con 0x55d2120b6d50 2022-09-17T10:27:49.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.954+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/3706202458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d21203a9e0 con 0x55d2120b6d50 2022-09-17T10:27:49.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d117fa700 1 -- 172.21.15.62:0/3706202458 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d2c0899f0 con 0x55d2120b6d50 2022-09-17T10:27:49.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d4eedbb80 10 client.4497 fetch_fsmap learned FSMap version 7 2022-09-17T10:27:49.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/3706202458 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d211dca990 con 0x55d2120b6d50 2022-09-17T10:27:49.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d117fa700 1 -- 172.21.15.62:0/3706202458 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d21203a9e0 con 0x55d2120b6d50 2022-09-17T10:27:49.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d117fa700 1 -- 172.21.15.62:0/3706202458 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f6d2c080180 con 0x55d2120b6d50 2022-09-17T10:27:49.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d4eedbb80 10 client.4497 fetch_fsmap finished waiting for FSMap version 7 2022-09-17T10:27:49.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d4eedbb80 10 client.4497 resolve_mds: resolved name 'f' to daemon mds.f 2022-09-17T10:27:49.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d4eedbb80 20 client.4497 populate_metadata read hostname 'smithi062' 2022-09-17T10:27:49.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55d21208abd0 0x55d2120d2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d4eedbb80 4 client.4497 mds_command: new command op to 4365 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-17T10:27:49.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/3706202458 --> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d211f8e7a0 con 0x55d21208abd0 2022-09-17T10:27:49.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.955+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55d21208abd0 0x55d2120d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d117fa700 10 client.4497 ms_handle_connect on v2:172.21.15.159:6835/802951039 2022-09-17T10:27:49.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55d21208abd0 0x55d2120d2480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4b48aebb746dc885 server_cookie=c1876faabf4dddc9 in_seq=0 out_seq=0 2022-09-17T10:27:49.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d117fa700 1 -- 172.21.15.62:0/3706202458 <== mds.0 v2:172.21.15.159:6835/802951039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55d211f8e7a0 con 0x55d21208abd0 2022-09-17T10:27:49.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d117fa700 10 client.4497 handle_command_reply: tid=0 2022-09-17T10:27:49.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 client.4497 shutdown 2022-09-17T10:27:49.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/3706202458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 msgr2=0x55d21208eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:49.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d21208eb80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6d2c0076c0 tx=0x7f6d2c052000).stop 2022-09-17T10:27:49.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/3706202458 shutdown_connections 2022-09-17T10:27:49.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d2120920f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55d21208abd0 0x55d2120d2480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120832f0 0x55d2120786c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/3706202458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b6d50 0x55d21208eb80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:49.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d117fa700 0 client.4497 ms_handle_reset on v2:172.21.15.159:6835/802951039 2022-09-17T10:27:49.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.956+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/3706202458 >> 172.21.15.62:0/3706202458 conn(0x55d212046a70 msgr2=0x55d2120b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:49.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.957+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/3706202458 shutdown_connections 2022-09-17T10:27:49.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.957+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/3706202458 wait complete. 2022-09-17T10:27:49.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.957+0000 7f6d4eedbb80 20 client.4497 trim_cache size 0 max 16384 2022-09-17T10:27:49.996 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.973+0000 7f6d4eedbb80 1 Processor -- start 2022-09-17T10:27:49.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.973+0000 7f6d4eedbb80 1 -- start start 2022-09-17T10:27:49.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120832f0 0x55d21208f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 0x55d21204e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d2120428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:49.998 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d212092530 con 0x55d2120832f0 2022-09-17T10:27:49.998 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21207f110 con 0x55d2120b71d0 2022-09-17T10:27:49.998 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21208d8a0 con 0x55d2120b6d50 2022-09-17T10:27:49.998 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d36ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120832f0 0x55d21208f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:49.999 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d36ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120832f0 0x55d21208f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36926/0 (socket says 172.21.15.62:36926) 2022-09-17T10:27:49.999 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.974+0000 7f6d36ffd700 1 -- 172.21.15.62:0/4049946838 learned_addr learned my addr 172.21.15.62:0/4049946838 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:49.999 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d36ffd700 1 -- 172.21.15.62:0/4049946838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 msgr2=0x55d21204e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:49.999 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/4049946838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 0x55d21204e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-09-17T10:27:49.999 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d36ffd700 1 -- 172.21.15.62:0/4049946838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 msgr2=0x55d2120428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:50.000 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/4049946838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d2120428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-09-17T10:27:50.000 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d36ffd700 1 -- 172.21.15.62:0/4049946838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d211e39c80 con 0x55d2120832f0 2022-09-17T10:27:50.000 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/4049946838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120832f0 0x55d21208f4c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6d28011000 tx=0x7f6d2802d280).ready entity=mon.0 client_cookie=9882d15686f22e7c server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:50.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d1cff9700 1 -- 172.21.15.62:0/4049946838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2802a070 con 0x55d2120832f0 2022-09-17T10:27:50.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d1cff9700 1 -- 172.21.15.62:0/4049946838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d28020070 con 0x55d2120832f0 2022-09-17T10:27:50.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d1cff9700 1 -- 172.21.15.62:0/4049946838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28025820 con 0x55d2120832f0 2022-09-17T10:27:50.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/4049946838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120832f0 msgr2=0x55d21208f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:50.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/4049946838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120832f0 0x55d21208f4c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6d28011000 tx=0x7f6d2802d280).stop 2022-09-17T10:27:50.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/4049946838 shutdown_connections 2022-09-17T10:27:50.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/4049946838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120b71d0 0x55d2120428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-09-17T10:27:50.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/4049946838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120832f0 0x55d21208f4c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/4049946838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 0x55d21204e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-09-17T10:27:50.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/4049946838 >> 172.21.15.62:0/4049946838 conn(0x55d212046a70 msgr2=0x55d212082920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:50.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/4049946838 shutdown_connections 2022-09-17T10:27:50.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.975+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/4049946838 wait complete. 2022-09-17T10:27:50.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.976+0000 7f6d4eedbb80 1 -- start start 2022-09-17T10:27:50.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.976+0000 7f6d4eedbb80 1 Processor -- start 2022-09-17T10:27:50.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120832f0 0x55d21203a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:50.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 0x55d2120c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:50.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d4eedbb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b71d0 0x55d21211a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:50.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2120afcc0 con 0x55d2120b71d0 2022-09-17T10:27:50.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2120aec30 con 0x55d2120832f0 2022-09-17T10:27:50.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d4eedbb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21207c380 con 0x55d2120b6d50 2022-09-17T10:27:50.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d4eedbb80 10 client.0 ll_register_callbacks cb 0x55d212006520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-17T10:27:50.006 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b71d0 0x55d21211a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:50.006 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b71d0 0x55d21211a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36938/0 (socket says 172.21.15.62:36938) 2022-09-17T10:27:50.006 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.977+0000 7f6d377fe700 1 -- 172.21.15.62:0/2432948807 learned_addr learned my addr 172.21.15.62:0/2432948807 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:50.006 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d367fc700 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 0x55d2120c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:50.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120832f0 0x55d21203a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:50.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d377fe700 1 -- 172.21.15.62:0/2432948807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 msgr2=0x55d2120c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:50.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d377fe700 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 0x55d2120c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d377fe700 1 -- 172.21.15.62:0/2432948807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120832f0 msgr2=0x55d21203a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:50.008 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d377fe700 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120832f0 0x55d21203a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.008 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d377fe700 1 -- 172.21.15.62:0/2432948807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3817f4e0 con 0x55d2120b71d0 2022-09-17T10:27:50.008 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d377fe700 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b71d0 0x55d21211a830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x55d2120b69e0 tx=0x7f6d30009040).ready entity=mon.0 client_cookie=47577f07e54d2017 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:50.008 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d117fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2022-09-17T10:27:50.009 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d117fa700 1 -- 172.21.15.62:0/2432948807 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30007b20 con 0x55d2120b71d0 2022-09-17T10:27:50.009 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d117fa700 1 -- 172.21.15.62:0/2432948807 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6d30016480 con 0x55d2120b71d0 2022-09-17T10:27:50.009 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/2432948807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d2c082730 con 0x55d2120b71d0 2022-09-17T10:27:50.009 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d117fa700 1 -- 172.21.15.62:0/2432948807 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d30016850 con 0x55d2120b71d0 2022-09-17T10:27:50.010 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 10 client.4503 fetch_fsmap learned FSMap version 7 2022-09-17T10:27:50.010 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/2432948807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d211e07f80 con 0x55d2120b71d0 2022-09-17T10:27:50.010 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d117fa700 1 -- 172.21.15.62:0/2432948807 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c082730 con 0x55d2120b71d0 2022-09-17T10:27:50.010 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d117fa700 1 -- 172.21.15.62:0/2432948807 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f6d300169b0 con 0x55d2120b71d0 2022-09-17T10:27:50.011 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 10 client.4503 fetch_fsmap finished waiting for FSMap version 7 2022-09-17T10:27:50.011 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 10 client.4503 resolve_mds: resolved name 'f' to daemon mds.f 2022-09-17T10:27:50.011 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 20 client.4503 populate_metadata read hostname 'smithi062' 2022-09-17T10:27:50.011 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55d2120892c0 0x55d2120896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:50.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 4 client.4503 mds_command: new command op to 4365 tid=0[{"prefix": "status"}] 2022-09-17T10:27:50.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.978+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/2432948807 --> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d211f85640 con 0x55d2120892c0 2022-09-17T10:27:50.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55d2120892c0 0x55d2120896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:50.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d117fa700 10 client.4503 ms_handle_connect on v2:172.21.15.159:6835/802951039 2022-09-17T10:27:50.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d36ffd700 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55d2120892c0 0x55d2120896a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c61ee341933b9125 server_cookie=43875e7dca7cd4a4 in_seq=0 out_seq=0 2022-09-17T10:27:50.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d117fa700 1 -- 172.21.15.62:0/2432948807 <== mds.0 v2:172.21.15.159:6835/802951039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55d211f85640 con 0x55d2120892c0 2022-09-17T10:27:50.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d117fa700 10 client.4503 handle_command_reply: tid=0 2022-09-17T10:27:50.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 client.4503 shutdown 2022-09-17T10:27:50.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/2432948807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b71d0 msgr2=0x55d21211a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:50.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b71d0 0x55d21211a830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x55d2120b69e0 tx=0x7f6d30009040).stop 2022-09-17T10:27:50.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/2432948807 shutdown_connections 2022-09-17T10:27:50.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2120832f0 0x55d21203a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55d2120892c0 0x55d2120896a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2120b71d0 0x55d21211a830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 --2- 172.21.15.62:0/2432948807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d2120b6d50 0x55d2120c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d117fa700 0 client.4503 ms_handle_reset on v2:172.21.15.159:6835/802951039 2022-09-17T10:27:50.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/2432948807 >> 172.21.15.62:0/2432948807 conn(0x55d212046a70 msgr2=0x55d2120c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:50.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/2432948807 shutdown_connections 2022-09-17T10:27:50.016 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.979+0000 7f6d4eedbb80 1 -- 172.21.15.62:0/2432948807 wait complete. 2022-09-17T10:27:50.016 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d4eedbb80 20 client.4503 trim_cache size 0 max 16384 2022-09-17T10:27:50.016 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2022-09-17T10:27:50.017 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "caff66e9-e5bf-4b11-8278-68b3c904b131", 2022-09-17T10:27:50.017 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2022-09-17T10:27:50.017 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4365, 2022-09-17T10:27:50.017 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2022-09-17T10:27:50.018 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2022-09-17T10:27:50.018 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2022-09-17T10:27:50.018 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 7.1850666070000004, 2022-09-17T10:27:50.018 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 7, 2022-09-17T10:27:50.018 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 31, 2022-09-17T10:27:50.019 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 30, 2022-09-17T10:27:50.019 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 12.425267849999999 2022-09-17T10:27:50.019 INFO:teuthology.orchestra.run.smithi062.stdout:} 2022-09-17T10:27:50.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 -- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6d1808ba40 msgr2=0x7f6d1808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:50.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6d1808ba40 0x7f6d1808df00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6d28009760 tx=0x7f6d28017000).stop 2022-09-17T10:27:50.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 -- 172.21.15.62:0/872708444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3817ebf0 msgr2=0x7f6d3817fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:50.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3817ebf0 0x7f6d3817fb70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6d2c00c410 tx=0x7f6d2c007e00).stop 2022-09-17T10:27:50.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 -- 172.21.15.62:0/872708444 shutdown_connections 2022-09-17T10:27:50.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6d1808ba40 0x7f6d1808df00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d3817f070 0x7f6d381927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3817dcd0 0x7f6d3818fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 --2- 172.21.15.62:0/872708444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3817ebf0 0x7f6d3817fb70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:50.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 -- 172.21.15.62:0/872708444 >> 172.21.15.62:0/872708444 conn(0x7f6d380de5f0 msgr2=0x7f6d3817cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 -- 172.21.15.62:0/872708444 shutdown_connections 2022-09-17T10:27:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:49.980+0000 7f6d37fff700 1 -- 172.21.15.62:0/872708444 wait complete. 2022-09-17T10:27:50.024 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-09-17T10:27:50.025 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2022-09-17T10:27:50.026 INFO:tasks.cephfs.mount:self.client.name = client.admin 2022-09-17T10:27:50.026 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2022-09-17T10:27:50.027 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2022-09-17T10:27:50.027 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-09-17T10:27:50.027 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-09-17T10:27:50.028 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2022-09-17T10:27:50.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.029 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2022-09-17T10:27:50.044 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-09-17T10:27:50.045 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-09-17T10:27:50.045 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2022-09-17T10:27:50.045 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2022-09-17T10:27:50.045 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2022-09-17T10:27:50.046 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2022-09-17T10:27:50.046 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-17T10:27:50.046 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2022-09-17T10:27:50.046 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-17T10:27:50.047 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2022-09-17T10:27:50.047 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-17T10:27:50.047 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2022-09-17T10:27:50.047 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-09-17T10:27:50.048 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2022-09-17T10:27:50.048 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-09-17T10:27:50.048 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42508sec preferred_lft 42508sec 2022-09-17T10:27:50.048 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2022-09-17T10:27:50.049 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2022-09-17T10:27:50.049 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-09-17T10:27:50.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.050 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:27:50.051 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:27:50.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2022-09-17T10:27:50.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2022-09-17T10:27:50.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2022-09-17T10:27:50.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-09-17T10:27:50.053 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:27:50.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.232 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-09-17T10:27:50.268 INFO:teuthology.orchestra.run.smithi062.stdout:1 2022-09-17T10:27:50.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.271 DEBUG:teuthology.orchestra.run.smithi062:> route 2022-09-17T10:27:50.338 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2022-09-17T10:27:50.339 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-09-17T10:27:50.339 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-09-17T10:27:50.339 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-09-17T10:27:50.339 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-09-17T10:27:50.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.340 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:27:50.341 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:27:50.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-09-17T10:27:50.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-09-17T10:27:50.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-09-17T10:27:50.342 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:27:50.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.567 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2022-09-17T10:27:50.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.585 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2022-09-17T10:27:50.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.640 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:27:50.640 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:27:50.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-09-17T10:27:50.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2022-09-17T10:27:50.641 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:27:50.731 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2022-09-17T10:27:50.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.733 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:27:50.734 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:27:50.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2022-09-17T10:27:50.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-09-17T10:27:50.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2022-09-17T10:27:50.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2022-09-17T10:27:50.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2022-09-17T10:27:50.737 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:27:50.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:50.934 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:27:50.935 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:27:50.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2022-09-17T10:27:50.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2022-09-17T10:27:50.937 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:27:51.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:51.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.165+0000 7fbeb13cc700 1 Processor -- start 2022-09-17T10:27:51.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.165+0000 7fbeb13cc700 1 -- start start 2022-09-17T10:27:51.177 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.166+0000 7fbeb13cc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbeac17ba00 0x7fbeac17ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.166+0000 7fbeb13cc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbeac17cf00 0x7fbeac0e4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.166+0000 7fbeb13cc700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac0e5ed0 con 0x7fbeac17bde0 2022-09-17T10:27:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.166+0000 7fbeb13cc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac0e4fe0 con 0x7fbeac17ba00 2022-09-17T10:27:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.166+0000 7fbeb13cc700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac0e52c0 con 0x7fbeac17cf00 2022-09-17T10:27:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.166+0000 7fbeabfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbeac17ba00 0x7fbeac17ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeabfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbeac17ba00 0x7fbeac17ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36944/0 (socket says 172.21.15.62:36944) 2022-09-17T10:27:51.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeabfff700 1 -- 172.21.15.62:0/4179068497 learned_addr learned my addr 172.21.15.62:0/4179068497 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:51.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeab7fe700 1 --2- 172.21.15.62:0/4179068497 >> v2:172.21.15.93:3300/0 conn(0x7fbeac17cf00 0x7fbeac0e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeabfff700 1 -- 172.21.15.62:0/4179068497 >> v2:172.21.15.93:3300/0 conn(0x7fbeac17cf00 msgr2=0x7fbeac0e4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:51.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeabfff700 1 --2- 172.21.15.62:0/4179068497 >> v2:172.21.15.93:3300/0 conn(0x7fbeac17cf00 0x7fbeac0e4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.181 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeabfff700 1 -- 172.21.15.62:0/4179068497 >> v1:172.21.15.159:6789/0 conn(0x7fbeac17bde0 legacy=0x7fbeac17d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:51.181 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeabfff700 1 -- 172.21.15.62:0/4179068497 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0e55a0 con 0x7fbeac17ba00 2022-09-17T10:27:51.181 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeab7fe700 1 --2- 172.21.15.62:0/4179068497 >> v2:172.21.15.93:3300/0 conn(0x7fbeac17cf00 0x7fbeac0e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:51.181 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeabfff700 1 --2- 172.21.15.62:0/4179068497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17ba00 0x7fbeac17ca10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fbeac0eeed0 tx=0x7fbe9c0090f0).ready entity=mon.0 client_cookie=db1281c6cbc5c9ba server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.182 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeaaffd700 1 -- 172.21.15.62:0/4179068497 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00b600 con 0x7fbeac17ba00 2022-09-17T10:27:51.182 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeaaffd700 1 -- 172.21.15.62:0/4179068497 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00b760 con 0x7fbeac17ba00 2022-09-17T10:27:51.182 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.167+0000 7fbeaaffd700 1 -- 172.21.15.62:0/4179068497 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00bb00 con 0x7fbeac17ba00 2022-09-17T10:27:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.168+0000 7fbeb13cc700 1 -- 172.21.15.62:0/4179068497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17ba00 msgr2=0x7fbeac17ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.168+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/4179068497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17ba00 0x7fbeac17ca10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fbeac0eeed0 tx=0x7fbe9c0090f0).stop 2022-09-17T10:27:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.168+0000 7fbeb13cc700 1 -- 172.21.15.62:0/4179068497 shutdown_connections 2022-09-17T10:27:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.168+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/4179068497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17ba00 0x7fbeac17ca10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.168+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/4179068497 >> v2:172.21.15.93:3300/0 conn(0x7fbeac17cf00 0x7fbeac0e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.168+0000 7fbeb13cc700 1 -- 172.21.15.62:0/4179068497 >> 172.21.15.62:0/4179068497 conn(0x7fbeac0e1d00 msgr2=0x7fbeac0dfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.168+0000 7fbeb13cc700 1 -- 172.21.15.62:0/4179068497 shutdown_connections 2022-09-17T10:27:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.168+0000 7fbeb13cc700 1 -- 172.21.15.62:0/4179068497 wait complete. 2022-09-17T10:27:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.169+0000 7fbeb13cc700 1 Processor -- start 2022-09-17T10:27:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.169+0000 7fbeb13cc700 1 -- start start 2022-09-17T10:27:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb13cc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeac17ba00 0x7fbeac174940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb13cc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac17bde0 0x7fbeac174e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb13cc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17cf00 0x7fbeac177850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb13cc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0ba0b0 con 0x7fbeac17cf00 2022-09-17T10:27:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb13cc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0b91c0 con 0x7fbeac17bde0 2022-09-17T10:27:51.187 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb13cc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0b94a0 con 0x7fbeac17ba00 2022-09-17T10:27:51.187 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb0bcb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17cf00 0x7fbeac177850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.187 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb0bcb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17cf00 0x7fbeac177850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36950/0 (socket says 172.21.15.62:36950) 2022-09-17T10:27:51.188 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.170+0000 7fbeb0bcb700 1 -- 172.21.15.62:0/1802038809 learned_addr learned my addr 172.21.15.62:0/1802038809 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:51.188 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeabfff700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeac17ba00 0x7fbeac174940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeab7fe700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac17bde0 0x7fbeac174e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeb0bcb700 1 -- 172.21.15.62:0/1802038809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeac17ba00 msgr2=0x7fbeac174940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeb0bcb700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeac17ba00 0x7fbeac174940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeb0bcb700 1 -- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac17bde0 msgr2=0x7fbeac174e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeb0bcb700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac17bde0 0x7fbeac174e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeb0bcb700 1 -- 172.21.15.62:0/1802038809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c009370 con 0x7fbeac17cf00 2022-09-17T10:27:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeab7fe700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac17bde0 0x7fbeac174e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:51.192 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeb0bcb700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17cf00 0x7fbeac177850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fbea400c7c0 tx=0x7fbea4001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.192 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbe93fff700 1 -- 172.21.15.62:0/1802038809 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400e4a0 con 0x7fbeac17cf00 2022-09-17T10:27:51.193 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbe93fff700 1 -- 172.21.15.62:0/1802038809 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea400e600 con 0x7fbeac17cf00 2022-09-17T10:27:51.193 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac0b9780 con 0x7fbeac17cf00 2022-09-17T10:27:51.194 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbe93fff700 1 -- 172.21.15.62:0/1802038809 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400e980 con 0x7fbeac17cf00 2022-09-17T10:27:51.194 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.171+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac0b9d40 con 0x7fbeac17cf00 2022-09-17T10:27:51.195 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.172+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac0ba260 con 0x7fbeac17cf00 2022-09-17T10:27:51.195 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.173+0000 7fbe93fff700 1 -- 172.21.15.62:0/1802038809 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fbea4019030 con 0x7fbeac17cf00 2022-09-17T10:27:51.196 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.173+0000 7fbe93fff700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbe8c08ba40 0x7fbe8c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.196 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.174+0000 7fbe93fff700 1 -- 172.21.15.62:0/1802038809 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fbea40afe40 con 0x7fbeac17cf00 2022-09-17T10:27:51.197 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.174+0000 7fbeabfff700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbe8c08ba40 0x7fbe8c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.197 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.174+0000 7fbeabfff700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbe8c08ba40 0x7fbe8c08df00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fbe9c009fd0 tx=0x7fbe9c017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.198 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.177+0000 7fbe93fff700 1 -- 172.21.15.62:0/1802038809 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fbeac0ba260 con 0x7fbeac17cf00 2022-09-17T10:27:51.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.352+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbeac06be90 con 0x7fbeac17cf00 2022-09-17T10:27:51.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.353+0000 7fbe93fff700 1 -- 172.21.15.62:0/1802038809 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7fbea4017020 con 0x7fbeac17cf00 2022-09-17T10:27:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:51.357 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:51.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbe8c08ba40 msgr2=0x7fbe8c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbe8c08ba40 0x7fbe8c08df00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fbe9c009fd0 tx=0x7fbe9c017000).stop 2022-09-17T10:27:51.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17cf00 msgr2=0x7fbeac177850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17cf00 0x7fbeac177850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fbea400c7c0 tx=0x7fbea4001510).stop 2022-09-17T10:27:51.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 shutdown_connections 2022-09-17T10:27:51.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbe8c08ba40 0x7fbe8c08df00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeac17cf00 0x7fbeac177850 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeac17ba00 0x7fbeac174940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 --2- 172.21.15.62:0/1802038809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac17bde0 0x7fbeac174e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 >> 172.21.15.62:0/1802038809 conn(0x7fbeac0e1d00 msgr2=0x7fbeac0e97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:51.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 shutdown_connections 2022-09-17T10:27:51.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.355+0000 7fbeb13cc700 1 -- 172.21.15.62:0/1802038809 wait complete. 2022-09-17T10:27:51.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-09-17T10:27:32.392964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-09-17T10:27:35.474566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-09-17T10:27:40.468667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-09-17T10:27:41.769803+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-09-17T10:27:44.846733+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-09-17T10:27:51.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-09-17T10:27:51.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.490+0000 7f7a5604f700 1 Processor -- start 2022-09-17T10:27:51.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.490+0000 7f7a5604f700 1 -- start start 2022-09-17T10:27:51.503 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a5604f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a501751b0 0x7f7a50180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a5604f700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7a500ef650 0x7f7a500efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a5604f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a500c6dd0 con 0x7f7a50175590 2022-09-17T10:27:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a5604f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a500f10e0 con 0x7f7a501751b0 2022-09-17T10:27:51.504 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a5604f700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a501801e0 con 0x7f7a500ef650 2022-09-17T10:27:51.505 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a4f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a501751b0 0x7f7a50180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.505 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a4f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a501751b0 0x7f7a50180670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36956/0 (socket says 172.21.15.62:36956) 2022-09-17T10:27:51.505 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a4f7fe700 1 -- 172.21.15.62:0/303578552 learned_addr learned my addr 172.21.15.62:0/303578552 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:51.505 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a4ffff700 1 --2- 172.21.15.62:0/303578552 >> v2:172.21.15.159:3300/0 conn(0x7f7a500ef650 0x7f7a500efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.506 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a4f7fe700 1 -- 172.21.15.62:0/303578552 >> v2:172.21.15.159:3300/0 conn(0x7f7a500ef650 msgr2=0x7f7a500efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:51.506 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a4f7fe700 1 --2- 172.21.15.62:0/303578552 >> v2:172.21.15.159:3300/0 conn(0x7f7a500ef650 0x7f7a500efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.506 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a4f7fe700 1 -- 172.21.15.62:0/303578552 >> v1:172.21.15.93:6789/0 conn(0x7f7a50175590 legacy=0x7f7a50180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.507 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.491+0000 7f7a4f7fe700 1 -- 172.21.15.62:0/303578552 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a500f0840 con 0x7f7a501751b0 2022-09-17T10:27:51.507 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a4f7fe700 1 --2- 172.21.15.62:0/303578552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a501751b0 0x7f7a50180670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f7a50088650 tx=0x7f7a400090f0).ready entity=mon.0 client_cookie=d23a70ccaca0a8be server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.507 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a4e7fc700 1 -- 172.21.15.62:0/303578552 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000b600 con 0x7f7a501751b0 2022-09-17T10:27:51.508 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a4e7fc700 1 -- 172.21.15.62:0/303578552 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4000b760 con 0x7f7a501751b0 2022-09-17T10:27:51.508 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a4e7fc700 1 -- 172.21.15.62:0/303578552 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000bb00 con 0x7f7a501751b0 2022-09-17T10:27:51.508 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a5604f700 1 -- 172.21.15.62:0/303578552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a501751b0 msgr2=0x7f7a50180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a5604f700 1 --2- 172.21.15.62:0/303578552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a501751b0 0x7f7a50180670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f7a50088650 tx=0x7f7a400090f0).stop 2022-09-17T10:27:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a5604f700 1 -- 172.21.15.62:0/303578552 shutdown_connections 2022-09-17T10:27:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a5604f700 1 --2- 172.21.15.62:0/303578552 >> v2:172.21.15.159:3300/0 conn(0x7f7a500ef650 0x7f7a500efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a5604f700 1 --2- 172.21.15.62:0/303578552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a501751b0 0x7f7a50180670 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a5604f700 1 -- 172.21.15.62:0/303578552 >> 172.21.15.62:0/303578552 conn(0x7f7a5006a170 msgr2=0x7f7a500f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a5604f700 1 -- 172.21.15.62:0/303578552 shutdown_connections 2022-09-17T10:27:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.492+0000 7f7a5604f700 1 -- 172.21.15.62:0/303578552 wait complete. 2022-09-17T10:27:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.494+0000 7f7a5604f700 1 Processor -- start 2022-09-17T10:27:51.510 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.494+0000 7f7a5604f700 1 -- start start 2022-09-17T10:27:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a5604f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500ef650 0x7f7a50168900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a5604f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a501751b0 0x7f7a50168df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a5604f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a50175590 0x7f7a5016d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a5604f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500c94b0 con 0x7f7a500ef650 2022-09-17T10:27:51.512 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a5604f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500c85e0 con 0x7f7a50175590 2022-09-17T10:27:51.512 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a5604f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500c88a0 con 0x7f7a501751b0 2022-09-17T10:27:51.512 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a4f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500ef650 0x7f7a50168900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.512 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a4f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500ef650 0x7f7a50168900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36970/0 (socket says 172.21.15.62:36970) 2022-09-17T10:27:51.513 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a4f7fe700 1 -- 172.21.15.62:0/36479615 learned_addr learned my addr 172.21.15.62:0/36479615 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:51.513 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a4effd700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a501751b0 0x7f7a50168df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.513 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a4ffff700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a50175590 0x7f7a5016d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.514 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a4f7fe700 1 -- 172.21.15.62:0/36479615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a501751b0 msgr2=0x7f7a50168df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.514 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.495+0000 7f7a4f7fe700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a501751b0 0x7f7a50168df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.515 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a4f7fe700 1 -- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a50175590 msgr2=0x7f7a5016d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.515 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a4f7fe700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a50175590 0x7f7a5016d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.515 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a4f7fe700 1 -- 172.21.15.62:0/36479615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40009370 con 0x7f7a500ef650 2022-09-17T10:27:51.516 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a4ffff700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a50175590 0x7f7a5016d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:51.516 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a4f7fe700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500ef650 0x7f7a50168900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f7a50088960 tx=0x7f7a40017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.517 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a377fe700 1 -- 172.21.15.62:0/36479615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000bec0 con 0x7f7a500ef650 2022-09-17T10:27:51.517 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a377fe700 1 -- 172.21.15.62:0/36479615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4000b8d0 con 0x7f7a500ef650 2022-09-17T10:27:51.518 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a377fe700 1 -- 172.21.15.62:0/36479615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40024470 con 0x7f7a500ef650 2022-09-17T10:27:51.518 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a500c8b80 con 0x7f7a500ef650 2022-09-17T10:27:51.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.496+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a500c9140 con 0x7f7a500ef650 2022-09-17T10:27:51.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.497+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a500c9790 con 0x7f7a500ef650 2022-09-17T10:27:51.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.498+0000 7f7a377fe700 1 -- 172.21.15.62:0/36479615 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f7a4000f070 con 0x7f7a500ef650 2022-09-17T10:27:51.520 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.498+0000 7f7a377fe700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7a3008ba10 0x7f7a3008ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.520 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.498+0000 7f7a377fe700 1 -- 172.21.15.62:0/36479615 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7a400b24f0 con 0x7f7a500ef650 2022-09-17T10:27:51.520 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.499+0000 7f7a4effd700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7a3008ba10 0x7f7a3008ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.520 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.499+0000 7f7a4effd700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7a3008ba10 0x7f7a3008ded0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7a500f06d0 tx=0x7f7a44009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.521 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.502+0000 7f7a377fe700 1 -- 172.21.15.62:0/36479615 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f7a400831b0 con 0x7f7a500ef650 2022-09-17T10:27:51.676 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.674+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7a5006bf40 con 0x7f7a500ef650 2022-09-17T10:27:51.677 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.675+0000 7f7a377fe700 1 -- 172.21.15.62:0/36479615 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7a40029030 con 0x7f7a500ef650 2022-09-17T10:27:51.677 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2022-09-17T10:27:51.679 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7a3008ba10 msgr2=0x7f7a3008ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.679 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7a3008ba10 0x7f7a3008ded0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7a500f06d0 tx=0x7f7a44009040).stop 2022-09-17T10:27:51.680 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500ef650 msgr2=0x7f7a50168900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.680 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500ef650 0x7f7a50168900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f7a50088960 tx=0x7f7a40017000).stop 2022-09-17T10:27:51.680 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 shutdown_connections 2022-09-17T10:27:51.680 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7a3008ba10 0x7f7a3008ded0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.681 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a50175590 0x7f7a5016d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.681 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500ef650 0x7f7a50168900 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.681 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 --2- 172.21.15.62:0/36479615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a501751b0 0x7f7a50168df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.681 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.676+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 >> 172.21.15.62:0/36479615 conn(0x7f7a5006a170 msgr2=0x7f7a501809e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:51.682 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.677+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 shutdown_connections 2022-09-17T10:27:51.682 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.677+0000 7f7a5604f700 1 -- 172.21.15.62:0/36479615 wait complete. 2022-09-17T10:27:51.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-17T10:27:51.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.808+0000 7f8ccc3ca700 1 Processor -- start 2022-09-17T10:27:51.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.808+0000 7f8ccc3ca700 1 -- start start 2022-09-17T10:27:51.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.809+0000 7f8ccc3ca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8cc4175590 0x7f8cc4180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.809+0000 7f8ccc3ca700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8cc40ef650 0x7f8cc40efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.809+0000 7f8ccc3ca700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40c6dd0 con 0x7f8cc41751b0 2022-09-17T10:27:51.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.809+0000 7f8ccc3ca700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40f10e0 con 0x7f8cc4175590 2022-09-17T10:27:51.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.809+0000 7f8ccc3ca700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc41801e0 con 0x7f8cc40ef650 2022-09-17T10:27:51.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9965700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8cc4175590 0x7f8cc4180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9965700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8cc4175590 0x7f8cc4180d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36972/0 (socket says 172.21.15.62:36972) 2022-09-17T10:27:51.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9965700 1 -- 172.21.15.62:0/4276340579 learned_addr learned my addr 172.21.15.62:0/4276340579 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cca967700 1 --2- 172.21.15.62:0/4276340579 >> v2:172.21.15.159:3300/0 conn(0x7f8cc40ef650 0x7f8cc40efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9965700 1 -- 172.21.15.62:0/4276340579 >> v2:172.21.15.159:3300/0 conn(0x7f8cc40ef650 msgr2=0x7f8cc40efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9965700 1 --2- 172.21.15.62:0/4276340579 >> v2:172.21.15.159:3300/0 conn(0x7f8cc40ef650 0x7f8cc40efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9965700 1 -- 172.21.15.62:0/4276340579 >> v1:172.21.15.93:6789/0 conn(0x7f8cc41751b0 legacy=0x7f8cc4180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9164700 1 -- 172.21.15.62:0/4276340579 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799050357 0 0) 0x7f8cc40c6dd0 con 0x7f8cc41751b0 2022-09-17T10:27:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9965700 1 -- 172.21.15.62:0/4276340579 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40f0840 con 0x7f8cc4175590 2022-09-17T10:27:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9965700 1 --2- 172.21.15.62:0/4276340579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc4175590 0x7f8cc4180d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8cc4088650 tx=0x7f8cb80090f0).ready entity=mon.0 client_cookie=ce798ba8e19d3e22 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9164700 1 -- 172.21.15.62:0/4276340579 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb800b520 con 0x7f8cc4175590 2022-09-17T10:27:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9164700 1 -- 172.21.15.62:0/4276340579 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb800b680 con 0x7f8cc4175590 2022-09-17T10:27:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.810+0000 7f8cc9164700 1 -- 172.21.15.62:0/4276340579 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb800ba20 con 0x7f8cc4175590 2022-09-17T10:27:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.811+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/4276340579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc4175590 msgr2=0x7f8cc4180d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.811+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/4276340579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc4175590 0x7f8cc4180d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8cc4088650 tx=0x7f8cb80090f0).stop 2022-09-17T10:27:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.811+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/4276340579 shutdown_connections 2022-09-17T10:27:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.811+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/4276340579 >> v2:172.21.15.159:3300/0 conn(0x7f8cc40ef650 0x7f8cc40efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.811+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/4276340579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc4175590 0x7f8cc4180d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.811+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/4276340579 >> 172.21.15.62:0/4276340579 conn(0x7f8cc406a170 msgr2=0x7f8cc40f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.811+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/4276340579 shutdown_connections 2022-09-17T10:27:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.811+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/4276340579 wait complete. 2022-09-17T10:27:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.812+0000 7f8ccc3ca700 1 Processor -- start 2022-09-17T10:27:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.812+0000 7f8ccc3ca700 1 -- start start 2022-09-17T10:27:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.813+0000 7f8ccc3ca700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cc40ef650 0x7f8cc4166220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.813+0000 7f8ccc3ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc41751b0 0x7f8cc40862f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.813+0000 7f8ccc3ca700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cc4175590 0x7f8cc40867e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.813+0000 7f8ccc3ca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4063140 con 0x7f8cc41751b0 2022-09-17T10:27:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.813+0000 7f8ccc3ca700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4087130 con 0x7f8cc40ef650 2022-09-17T10:27:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.813+0000 7f8ccc3ca700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4087410 con 0x7f8cc4175590 2022-09-17T10:27:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.813+0000 7f8cc9965700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc41751b0 0x7f8cc40862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc9965700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc41751b0 0x7f8cc40862f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36974/0 (socket says 172.21.15.62:36974) 2022-09-17T10:27:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc9965700 1 -- 172.21.15.62:0/1501802746 learned_addr learned my addr 172.21.15.62:0/1501802746 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cca967700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cc4175590 0x7f8cc40867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cca166700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cc40ef650 0x7f8cc4166220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc9965700 1 -- 172.21.15.62:0/1501802746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cc4175590 msgr2=0x7f8cc40867e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc9965700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cc4175590 0x7f8cc40867e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc9965700 1 -- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cc40ef650 msgr2=0x7f8cc4166220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc9965700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cc40ef650 0x7f8cc4166220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc9965700 1 -- 172.21.15.62:0/1501802746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb8009370 con 0x7f8cc41751b0 2022-09-17T10:27:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cca166700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cc40ef650 0x7f8cc4166220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:51.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc9965700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc41751b0 0x7f8cc40862f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8cc4088960 tx=0x7f8cb8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc27fc700 1 -- 172.21.15.62:0/1501802746 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8006970 con 0x7f8cc41751b0 2022-09-17T10:27:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc27fc700 1 -- 172.21.15.62:0/1501802746 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb8000bc0 con 0x7f8cc41751b0 2022-09-17T10:27:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc4062af0 con 0x7f8cc41751b0 2022-09-17T10:27:51.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8cc27fc700 1 -- 172.21.15.62:0/1501802746 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb800ba20 con 0x7f8cc41751b0 2022-09-17T10:27:51.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.814+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc4166710 con 0x7f8cc41751b0 2022-09-17T10:27:51.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.815+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc4062f90 con 0x7f8cc41751b0 2022-09-17T10:27:51.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.816+0000 7f8cc27fc700 1 -- 172.21.15.62:0/1501802746 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f8cb802d070 con 0x7f8cc41751b0 2022-09-17T10:27:51.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.816+0000 7f8cc27fc700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f8ca408ba40 0x7f8ca408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:51.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.817+0000 7f8cc27fc700 1 -- 172.21.15.62:0/1501802746 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f8cb80b2820 con 0x7f8cc41751b0 2022-09-17T10:27:51.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.817+0000 7f8cca166700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f8ca408ba40 0x7f8ca408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:51.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.817+0000 7f8cca166700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f8ca408ba40 0x7f8ca408df00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8cbc007fd0 tx=0x7f8cbc009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:51.832 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.820+0000 7f8cc27fc700 1 -- 172.21.15.62:0/1501802746 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f8cb80834e0 con 0x7f8cc41751b0 2022-09-17T10:27:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.991+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8cc40624f0 con 0x7f8cc41751b0 2022-09-17T10:27:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.991+0000 7f8cc27fc700 1 -- 172.21.15.62:0/1501802746 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8cb8021070 con 0x7f8cc41751b0 2022-09-17T10:27:51.994 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2022-09-17T10:27:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f8ca408ba40 msgr2=0x7f8ca408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f8ca408ba40 0x7f8ca408df00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8cbc007fd0 tx=0x7f8cbc009040).stop 2022-09-17T10:27:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc41751b0 msgr2=0x7f8cc40862f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc41751b0 0x7f8cc40862f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8cc4088960 tx=0x7f8cb8017000).stop 2022-09-17T10:27:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 shutdown_connections 2022-09-17T10:27:51.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f8ca408ba40 0x7f8ca408df00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cc40ef650 0x7f8cc4166220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8cc4175590 0x7f8cc40867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 --2- 172.21.15.62:0/1501802746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc41751b0 0x7f8cc40862f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:51.998 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 >> 172.21.15.62:0/1501802746 conn(0x7f8cc406a170 msgr2=0x7f8cc4087df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:51.998 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 shutdown_connections 2022-09-17T10:27:51.998 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:51.993+0000 7f8ccc3ca700 1 -- 172.21.15.62:0/1501802746 wait complete. 2022-09-17T10:27:52.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-09-17T10:27:52.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.125+0000 7efd969ac700 1 Processor -- start 2022-09-17T10:27:52.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.126+0000 7efd969ac700 1 -- start start 2022-09-17T10:27:52.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd969ac700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efd9017da90 0x7efd900e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd969ac700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd900b7730 con 0x7efd9017de70 2022-09-17T10:27:52.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd969ac700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd900ec220 con 0x7efd900e5220 2022-09-17T10:27:52.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd969ac700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd900e56d0 con 0x7efd9017da90 2022-09-17T10:27:52.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd959aa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efd9017da90 0x7efd900e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd951a9700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efd9017de70 0x7efd900b7bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58898/0 (socket says 172.21.15.62:58898) 2022-09-17T10:27:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd951a9700 1 -- 172.21.15.62:0/3024801714 learned_addr learned my addr 172.21.15.62:0/3024801714 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd959aa700 1 -- 172.21.15.62:0/3024801714 >> v1:172.21.15.159:6789/0 conn(0x7efd900e5220 legacy=0x7efd900b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd959aa700 1 -- 172.21.15.62:0/3024801714 >> v1:172.21.15.62:6789/0 conn(0x7efd9017de70 legacy=0x7efd900b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd959aa700 1 -- 172.21.15.62:0/3024801714 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd900ec500 con 0x7efd9017da90 2022-09-17T10:27:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd949a8700 1 -- 172.21.15.62:0/3024801714 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927528092 0 0) 0x7efd900b7730 con 0x7efd9017de70 2022-09-17T10:27:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd959aa700 1 --2- 172.21.15.62:0/3024801714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017da90 0x7efd900e4d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7efd88009760 tx=0x7efd88009060).ready entity=mon.0 client_cookie=c18ba9ed6a56bc86 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd949a8700 1 -- 172.21.15.62:0/3024801714 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800b520 con 0x7efd9017da90 2022-09-17T10:27:52.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd949a8700 1 -- 172.21.15.62:0/3024801714 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8800b680 con 0x7efd9017da90 2022-09-17T10:27:52.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.127+0000 7efd949a8700 1 -- 172.21.15.62:0/3024801714 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800ba00 con 0x7efd9017da90 2022-09-17T10:27:52.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.128+0000 7efd969ac700 1 -- 172.21.15.62:0/3024801714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017da90 msgr2=0x7efd900e4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.128+0000 7efd969ac700 1 --2- 172.21.15.62:0/3024801714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017da90 0x7efd900e4d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7efd88009760 tx=0x7efd88009060).stop 2022-09-17T10:27:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.128+0000 7efd969ac700 1 -- 172.21.15.62:0/3024801714 shutdown_connections 2022-09-17T10:27:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.128+0000 7efd969ac700 1 --2- 172.21.15.62:0/3024801714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017da90 0x7efd900e4d30 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0x7efd88009760 tx=0x7efd88009060).stop 2022-09-17T10:27:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.128+0000 7efd969ac700 1 -- 172.21.15.62:0/3024801714 >> 172.21.15.62:0/3024801714 conn(0x7efd9005d9a0 msgr2=0x7efd9005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.128+0000 7efd969ac700 1 -- 172.21.15.62:0/3024801714 shutdown_connections 2022-09-17T10:27:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.128+0000 7efd969ac700 1 -- 172.21.15.62:0/3024801714 wait complete. 2022-09-17T10:27:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.129+0000 7efd969ac700 1 Processor -- start 2022-09-17T10:27:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.129+0000 7efd969ac700 1 -- start start 2022-09-17T10:27:52.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.130+0000 7efd969ac700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd900e5220 0x7efd90172420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.130+0000 7efd969ac700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017de70 0x7efd90172910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.130+0000 7efd969ac700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd9016ae00 0x7efd9016b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.130+0000 7efd969ac700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9017a7d0 con 0x7efd9017de70 2022-09-17T10:27:52.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.130+0000 7efd969ac700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd901731b0 con 0x7efd900e5220 2022-09-17T10:27:52.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.130+0000 7efd969ac700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd90173490 con 0x7efd9016ae00 2022-09-17T10:27:52.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.130+0000 7efd951a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017de70 0x7efd90172910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd951a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017de70 0x7efd90172910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36990/0 (socket says 172.21.15.62:36990) 2022-09-17T10:27:52.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd951a9700 1 -- 172.21.15.62:0/3041358229 learned_addr learned my addr 172.21.15.62:0/3041358229 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:52.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd961ab700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd9016ae00 0x7efd9016b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd959aa700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd900e5220 0x7efd90172420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd951a9700 1 -- 172.21.15.62:0/3041358229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd9016ae00 msgr2=0x7efd9016b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd951a9700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd9016ae00 0x7efd9016b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd951a9700 1 -- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd900e5220 msgr2=0x7efd90172420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd951a9700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd900e5220 0x7efd90172420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd951a9700 1 -- 172.21.15.62:0/3041358229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd880092a0 con 0x7efd9017de70 2022-09-17T10:27:52.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd961ab700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd9016ae00 0x7efd9016b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:52.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd959aa700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd900e5220 0x7efd90172420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:52.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd951a9700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017de70 0x7efd90172910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7efd84001eb0 tx=0x7efd84007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd8dffb700 1 -- 172.21.15.62:0/3041358229 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840072e0 con 0x7efd9017de70 2022-09-17T10:27:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd8dffb700 1 -- 172.21.15.62:0/3041358229 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd84007440 con 0x7efd9017de70 2022-09-17T10:27:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd8dffb700 1 -- 172.21.15.62:0/3041358229 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840057a0 con 0x7efd9017de70 2022-09-17T10:27:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd90173770 con 0x7efd9017de70 2022-09-17T10:27:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.131+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9017a460 con 0x7efd9017de70 2022-09-17T10:27:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.132+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9017a980 con 0x7efd9017de70 2022-09-17T10:27:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.133+0000 7efd8dffb700 1 -- 172.21.15.62:0/3041358229 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7efd84010070 con 0x7efd9017de70 2022-09-17T10:27:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.134+0000 7efd8dffb700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7efd7008ba70 0x7efd7008df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.134+0000 7efd8dffb700 1 -- 172.21.15.62:0/3041358229 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7efd840affa0 con 0x7efd9017de70 2022-09-17T10:27:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.134+0000 7efd959aa700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7efd7008ba70 0x7efd7008df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.134+0000 7efd959aa700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7efd7008ba70 0x7efd7008df30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7efd900e2bb0 tx=0x7efd88017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.138+0000 7efd8dffb700 1 -- 172.21.15.62:0/3041358229 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7efd9017a980 con 0x7efd9017de70 2022-09-17T10:27:52.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.308+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd9017a910 con 0x7efd9017de70 2022-09-17T10:27:52.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.308+0000 7efd8dffb700 1 -- 172.21.15.62:0/3041358229 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd84080be0 con 0x7efd9017de70 2022-09-17T10:27:52.311 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2022-09-17T10:27:52.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7efd7008ba70 msgr2=0x7efd7008df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.313 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7efd7008ba70 0x7efd7008df30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7efd900e2bb0 tx=0x7efd88017000).stop 2022-09-17T10:27:52.313 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017de70 msgr2=0x7efd90172910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.313 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017de70 0x7efd90172910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7efd84001eb0 tx=0x7efd84007e90).stop 2022-09-17T10:27:52.313 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 shutdown_connections 2022-09-17T10:27:52.314 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7efd7008ba70 0x7efd7008df30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.314 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd900e5220 0x7efd90172420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.314 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd9016ae00 0x7efd9016b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.314 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 --2- 172.21.15.62:0/3041358229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9017de70 0x7efd90172910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.315 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 >> 172.21.15.62:0/3041358229 conn(0x7efd9005d9a0 msgr2=0x7efd900eef30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:52.315 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 shutdown_connections 2022-09-17T10:27:52.315 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.310+0000 7efd969ac700 1 -- 172.21.15.62:0/3041358229 wait complete. 2022-09-17T10:27:52.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-09-17T10:27:52.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.442+0000 7facc1537700 1 Processor -- start 2022-09-17T10:27:52.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.442+0000 7facc1537700 1 -- start start 2022-09-17T10:27:52.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.443+0000 7facc1537700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7facbc175590 0x7facbc180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.443+0000 7facc1537700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc0c6dd0 con 0x7facbc1751b0 2022-09-17T10:27:52.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.443+0000 7facc1537700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc1801e0 con 0x7facbc0ef650 2022-09-17T10:27:52.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.443+0000 7facc1537700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc0f10e0 con 0x7facbc175590 2022-09-17T10:27:52.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facba7fc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7facbc175590 0x7facbc180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facba7fc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7facbc175590 0x7facbc180d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.62:43870/0 (socket says 172.21.15.62:43870) 2022-09-17T10:27:52.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facba7fc700 1 -- 172.21.15.62:0/2542994446 learned_addr learned my addr 172.21.15.62:0/2542994446 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:52.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facbaffd700 1 --1- 172.21.15.62:0/2542994446 >> v1:172.21.15.93:6789/0 conn(0x7facbc1751b0 0x7facbc180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.62:36354/0 (socket says 172.21.15.62:36354) 2022-09-17T10:27:52.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facba7fc700 1 -- 172.21.15.62:0/2542994446 >> v1:172.21.15.159:6789/0 conn(0x7facbc0ef650 legacy=0x7facbc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facba7fc700 1 -- 172.21.15.62:0/2542994446 >> v1:172.21.15.93:6789/0 conn(0x7facbc1751b0 legacy=0x7facbc180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facb9ffb700 1 -- 172.21.15.62:0/2542994446 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435698704 0 0) 0x7facbc0c6dd0 con 0x7facbc1751b0 2022-09-17T10:27:52.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facba7fc700 1 -- 172.21.15.62:0/2542994446 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0f0840 con 0x7facbc175590 2022-09-17T10:27:52.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facba7fc700 1 --2- 172.21.15.62:0/2542994446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 0x7facbc180d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7faca4006fd0 tx=0x7faca40090f0).ready entity=mon.1 client_cookie=454ea323c637a073 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facb9ffb700 1 -- 172.21.15.62:0/2542994446 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400b600 con 0x7facbc175590 2022-09-17T10:27:52.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facb9ffb700 1 -- 172.21.15.62:0/2542994446 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca400b760 con 0x7facbc175590 2022-09-17T10:27:52.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.444+0000 7facb9ffb700 1 -- 172.21.15.62:0/2542994446 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400bb00 con 0x7facbc175590 2022-09-17T10:27:52.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.445+0000 7facc1537700 1 -- 172.21.15.62:0/2542994446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 msgr2=0x7facbc180d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.445+0000 7facc1537700 1 --2- 172.21.15.62:0/2542994446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 0x7facbc180d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7faca4006fd0 tx=0x7faca40090f0).stop 2022-09-17T10:27:52.452 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.445+0000 7facc1537700 1 -- 172.21.15.62:0/2542994446 shutdown_connections 2022-09-17T10:27:52.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.445+0000 7facc1537700 1 --2- 172.21.15.62:0/2542994446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 0x7facbc180d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.445+0000 7facc1537700 1 -- 172.21.15.62:0/2542994446 >> 172.21.15.62:0/2542994446 conn(0x7facbc06a170 msgr2=0x7facbc0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:52.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.445+0000 7facc1537700 1 -- 172.21.15.62:0/2542994446 shutdown_connections 2022-09-17T10:27:52.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.445+0000 7facc1537700 1 -- 172.21.15.62:0/2542994446 wait complete. 2022-09-17T10:27:52.459 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.446+0000 7facc1537700 1 Processor -- start 2022-09-17T10:27:52.459 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.446+0000 7facc1537700 1 -- start start 2022-09-17T10:27:52.460 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.447+0000 7facc1537700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0ef650 0x7facbc16e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.460 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.447+0000 7facc1537700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facbc1751b0 0x7facbc17e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.460 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.447+0000 7facc1537700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 0x7facbc0f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.447+0000 7facc1537700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0f4570 con 0x7facbc0ef650 2022-09-17T10:27:52.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.447+0000 7facc1537700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0f3680 con 0x7facbc175590 2022-09-17T10:27:52.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.447+0000 7facc1537700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0f3960 con 0x7facbc1751b0 2022-09-17T10:27:52.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0ef650 0x7facbc16e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0ef650 0x7facbc16e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37002/0 (socket says 172.21.15.62:37002) 2022-09-17T10:27:52.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 -- 172.21.15.62:0/3335699919 learned_addr learned my addr 172.21.15.62:0/3335699919 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:52.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbb7fe700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 0x7facbc0f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facba7fc700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facbc1751b0 0x7facbc17e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 -- 172.21.15.62:0/3335699919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facbc1751b0 msgr2=0x7facbc17e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facbc1751b0 0x7facbc17e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 -- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 msgr2=0x7facbc0f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 0x7facbc0f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 -- 172.21.15.62:0/3335699919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4009370 con 0x7facbc0ef650 2022-09-17T10:27:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facbaffd700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0ef650 0x7facbc16e300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7facb400c560 tx=0x7facb4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facb2ffd700 1 -- 172.21.15.62:0/3335699919 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40072e0 con 0x7facbc0ef650 2022-09-17T10:27:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facb2ffd700 1 -- 172.21.15.62:0/3335699919 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4007440 con 0x7facbc0ef650 2022-09-17T10:27:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc0f3c40 con 0x7facbc0ef650 2022-09-17T10:27:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facb2ffd700 1 -- 172.21.15.62:0/3335699919 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4005930 con 0x7facbc0ef650 2022-09-17T10:27:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.448+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc0f4200 con 0x7facbc0ef650 2022-09-17T10:27:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.449+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc06bf40 con 0x7facbc0ef650 2022-09-17T10:27:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.450+0000 7facb2ffd700 1 -- 172.21.15.62:0/3335699919 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7facb401a060 con 0x7facbc0ef650 2022-09-17T10:27:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.450+0000 7facb2ffd700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7faca008ba40 0x7faca008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.451+0000 7facb2ffd700 1 -- 172.21.15.62:0/3335699919 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7facb40aff60 con 0x7facbc0ef650 2022-09-17T10:27:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.451+0000 7facba7fc700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7faca008ba40 0x7faca008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.451+0000 7facba7fc700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7faca008ba40 0x7faca008df00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7faca4009130 tx=0x7faca4017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.454+0000 7facb2ffd700 1 -- 172.21.15.62:0/3335699919 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7facb4080c20 con 0x7facbc0ef650 2022-09-17T10:27:52.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.626+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7facbc0f0b20 con 0x7facbc0ef650 2022-09-17T10:27:52.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.626+0000 7facb2ffd700 1 -- 172.21.15.62:0/3335699919 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7facb4084240 con 0x7facbc0ef650 2022-09-17T10:27:52.629 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2022-09-17T10:27:52.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7faca008ba40 msgr2=0x7faca008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7faca008ba40 0x7faca008df00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7faca4009130 tx=0x7faca4017000).stop 2022-09-17T10:27:52.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0ef650 msgr2=0x7facbc16e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0ef650 0x7facbc16e300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7facb400c560 tx=0x7facb4007c90).stop 2022-09-17T10:27:52.631 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 shutdown_connections 2022-09-17T10:27:52.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7faca008ba40 0x7faca008df00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc175590 0x7facbc0f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facbc0ef650 0x7facbc16e300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 --2- 172.21.15.62:0/3335699919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facbc1751b0 0x7facbc17e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.632 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 >> 172.21.15.62:0/3335699919 conn(0x7facbc06a170 msgr2=0x7facbc17ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:52.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 shutdown_connections 2022-09-17T10:27:52.633 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.628+0000 7facc1537700 1 -- 172.21.15.62:0/3335699919 wait complete. 2022-09-17T10:27:52.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-09-17T10:27:52.762 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.760+0000 7fdd5e76a700 1 Processor -- start 2022-09-17T10:27:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.760+0000 7fdd5e76a700 1 -- start start 2022-09-17T10:27:52.777 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd5e76a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdd58063d00 0x7fdd5817dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.778 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd5e76a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd58175470 con 0x7fdd58174ff0 2022-09-17T10:27:52.778 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd5e76a700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5817c110 con 0x7fdd58174c10 2022-09-17T10:27:52.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd5e76a700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5817c3f0 con 0x7fdd58063d00 2022-09-17T10:27:52.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd577fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdd58174ff0 0x7fdd5817d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58910/0 (socket says 172.21.15.62:58910) 2022-09-17T10:27:52.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd577fe700 1 -- 172.21.15.62:0/1914607087 learned_addr learned my addr 172.21.15.62:0/1914607087 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:52.780 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd5cd07700 1 --2- 172.21.15.62:0/1914607087 >> v2:172.21.15.159:3300/0 conn(0x7fdd58063d00 0x7fdd5817dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.780 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109902519 0 0) 0x7fdd58175470 con 0x7fdd58174ff0 2022-09-17T10:27:52.781 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.761+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd440033f0 con 0x7fdd58174ff0 2022-09-17T10:27:52.781 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 683108800 0 0) 0x7fdd440033f0 con 0x7fdd58174ff0 2022-09-17T10:27:52.781 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 >> v2:172.21.15.159:3300/0 conn(0x7fdd58063d00 msgr2=0x7fdd5817dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:52.782 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 --2- 172.21.15.62:0/1914607087 >> v2:172.21.15.159:3300/0 conn(0x7fdd58063d00 0x7fdd5817dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.782 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 >> v1:172.21.15.159:6789/0 conn(0x7fdd58174c10 legacy=0x7fdd580635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.783 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5817c6d0 con 0x7fdd58174ff0 2022-09-17T10:27:52.783 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7fdd48001470 con 0x7fdd58174ff0 2022-09-17T10:27:52.784 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 >> v1:172.21.15.62:6789/0 conn(0x7fdd58174ff0 legacy=0x7fdd5817d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.784 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd44003930 0x7fdd44003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.784 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd44005000 0x7fdd4400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5817c3f0 con 0x7fdd44003930 2022-09-17T10:27:52.786 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4400bf30 con 0x7fdd44005000 2022-09-17T10:27:52.786 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4400c0f0 con 0x7fdd44004690 2022-09-17T10:27:52.786 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd577fe700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd57fff700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd44003930 0x7fdd44003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd5cd07700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd44005000 0x7fdd4400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd577fe700 1 -- 172.21.15.62:0/1914607087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd44005000 msgr2=0x7fdd4400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd577fe700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd44005000 0x7fdd4400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd577fe700 1 -- 172.21.15.62:0/1914607087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd44003930 msgr2=0x7fdd44003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:52.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd577fe700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd44003930 0x7fdd44003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd577fe700 1 -- 172.21.15.62:0/1914607087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440033f0 con 0x7fdd44004690 2022-09-17T10:27:52.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd5cd07700 1 -- 172.21.15.62:0/1914607087 reap_dead start 2022-09-17T10:27:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd57fff700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd44003930 0x7fdd44003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.762+0000 7fdd577fe700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd44004b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fdd4800c160 tx=0x7fdd5817e540).ready entity=mon.2 client_cookie=10a3348dd3122dc4 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800ca10 con 0x7fdd44004690 2022-09-17T10:27:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800cb70 con 0x7fdd44004690 2022-09-17T10:27:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd56ffd700 1 -- 172.21.15.62:0/1914607087 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd480070d0 con 0x7fdd44004690 2022-09-17T10:27:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd5e76a700 1 -- 172.21.15.62:0/1914607087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 msgr2=0x7fdd44004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd5e76a700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd44004b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fdd4800c160 tx=0x7fdd5817e540).stop 2022-09-17T10:27:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd5e76a700 1 -- 172.21.15.62:0/1914607087 shutdown_connections 2022-09-17T10:27:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd5e76a700 1 --2- 172.21.15.62:0/1914607087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd44004b10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd5e76a700 1 -- 172.21.15.62:0/1914607087 >> 172.21.15.62:0/1914607087 conn(0x7fdd580f4c90 msgr2=0x7fdd580f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:52.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd5e76a700 1 -- 172.21.15.62:0/1914607087 shutdown_connections 2022-09-17T10:27:52.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.763+0000 7fdd5e76a700 1 -- 172.21.15.62:0/1914607087 wait complete. 2022-09-17T10:27:52.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.764+0000 7fdd5e76a700 1 Processor -- start 2022-09-17T10:27:52.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.765+0000 7fdd5e76a700 1 -- start start 2022-09-17T10:27:52.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5e76a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd5818fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5e76a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58183fd0 0x7fdd58167120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5e76a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd58167610 0x7fdd58167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5e76a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58183b40 con 0x7fdd58167610 2022-09-17T10:27:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5e76a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581902f0 con 0x7fdd58183fd0 2022-09-17T10:27:52.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5e76a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581781f0 con 0x7fdd44004690 2022-09-17T10:27:52.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd58167610 0x7fdd58167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd58167610 0x7fdd58167a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37030/0 (socket says 172.21.15.62:37030) 2022-09-17T10:27:52.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 -- 172.21.15.62:0/2874016823 learned_addr learned my addr 172.21.15.62:0/2874016823 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd57fff700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd5818fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd577fe700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58183fd0 0x7fdd58167120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 -- 172.21.15.62:0/2874016823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 msgr2=0x7fdd5818fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd5818fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 -- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58183fd0 msgr2=0x7fdd58167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58183fd0 0x7fdd58167120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 -- 172.21.15.62:0/2874016823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58182f30 con 0x7fdd58167610 2022-09-17T10:27:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5cd07700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd58167610 0x7fdd58167a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fdd580ef330 tx=0x7fdd5000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd3ffff700 1 -- 172.21.15.62:0/2874016823 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000e070 con 0x7fdd58167610 2022-09-17T10:27:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd3ffff700 1 -- 172.21.15.62:0/2874016823 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50011c30 con 0x7fdd58167610 2022-09-17T10:27:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd58183210 con 0x7fdd58167610 2022-09-17T10:27:52.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd3ffff700 1 -- 172.21.15.62:0/2874016823 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50016450 con 0x7fdd58167610 2022-09-17T10:27:52.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.766+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd581837d0 con 0x7fdd58167610 2022-09-17T10:27:52.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.767+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5806bf40 con 0x7fdd58167610 2022-09-17T10:27:52.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.768+0000 7fdd3ffff700 1 -- 172.21.15.62:0/2874016823 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fdd5001d030 con 0x7fdd58167610 2022-09-17T10:27:52.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.769+0000 7fdd3ffff700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdd3808ba40 0x7fdd3808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:52.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.769+0000 7fdd3ffff700 1 -- 172.21.15.62:0/2874016823 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fdd500b0cf0 con 0x7fdd58167610 2022-09-17T10:27:52.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.769+0000 7fdd57fff700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdd3808ba40 0x7fdd3808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:52.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.769+0000 7fdd57fff700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdd3808ba40 0x7fdd3808df00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdd4c000c00 tx=0x7fdd4c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:52.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.773+0000 7fdd3ffff700 1 -- 172.21.15.62:0/2874016823 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fdd500819b0 con 0x7fdd58167610 2022-09-17T10:27:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.942+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdd5817c9b0 con 0x7fdd58167610 2022-09-17T10:27:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.942+0000 7fdd3ffff700 1 -- 172.21.15.62:0/2874016823 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdd5001b030 con 0x7fdd58167610 2022-09-17T10:27:52.945 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2022-09-17T10:27:52.946 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdd3808ba40 msgr2=0x7fdd3808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.946 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdd3808ba40 0x7fdd3808df00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdd4c000c00 tx=0x7fdd4c009040).stop 2022-09-17T10:27:52.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd58167610 msgr2=0x7fdd58167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:52.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd58167610 0x7fdd58167a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fdd580ef330 tx=0x7fdd5000b040).stop 2022-09-17T10:27:52.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 shutdown_connections 2022-09-17T10:27:52.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fdd3808ba40 0x7fdd3808df00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd58167610 0x7fdd58167a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd44004690 0x7fdd5818fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 --2- 172.21.15.62:0/2874016823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58183fd0 0x7fdd58167120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:52.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 >> 172.21.15.62:0/2874016823 conn(0x7fdd580f4c90 msgr2=0x7fdd580ec090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:52.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 shutdown_connections 2022-09-17T10:27:52.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:52.944+0000 7fdd5e76a700 1 -- 172.21.15.62:0/2874016823 wait complete. 2022-09-17T10:27:52.959 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-09-17T10:27:52.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-17T10:27:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.075+0000 7f96cbe37700 1 Processor -- start 2022-09-17T10:27:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.076+0000 7f96cbe37700 1 -- start start 2022-09-17T10:27:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96cbe37700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f96c41751b0 0x7f96c4180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96cbe37700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f96c4175590 0x7f96c4180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96cbe37700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40c6dd0 con 0x7f96c4181050 2022-09-17T10:27:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96cbe37700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40f10e0 con 0x7f96c41751b0 2022-09-17T10:27:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96cbe37700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40f0660 con 0x7f96c4175590 2022-09-17T10:27:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c93d2700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f96c4175590 0x7f96c4180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c93d2700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f96c4175590 0x7f96c4180b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.62:60284/0 (socket says 172.21.15.62:60284) 2022-09-17T10:27:53.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c93d2700 1 -- 172.21.15.62:0/2271886403 learned_addr learned my addr 172.21.15.62:0/2271886403 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:53.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c9bd3700 1 --2- 172.21.15.62:0/2271886403 >> v2:172.21.15.93:3300/0 conn(0x7f96c41751b0 0x7f96c4180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:53.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c93d2700 1 -- 172.21.15.62:0/2271886403 >> v2:172.21.15.93:3300/0 conn(0x7f96c41751b0 msgr2=0x7f96c4180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:53.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c93d2700 1 --2- 172.21.15.62:0/2271886403 >> v2:172.21.15.93:3300/0 conn(0x7f96c41751b0 0x7f96c4180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c93d2700 1 -- 172.21.15.62:0/2271886403 >> v1:172.21.15.93:6789/0 conn(0x7f96c4181050 legacy=0x7f96c4181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:53.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c93d2700 1 -- 172.21.15.62:0/2271886403 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c41801e0 con 0x7f96c4175590 2022-09-17T10:27:53.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.077+0000 7f96c93d2700 1 --2- 172.21.15.62:0/2271886403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 0x7f96c4180b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f96c4085780 tx=0x7f96b80090f0).ready entity=mon.2 client_cookie=73be81b471729aa5 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:53.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96c8bd1700 1 -- 172.21.15.62:0/2271886403 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800b520 con 0x7f96c4175590 2022-09-17T10:27:53.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96c8bd1700 1 -- 172.21.15.62:0/2271886403 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b800b680 con 0x7f96c4175590 2022-09-17T10:27:53.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96c8bd1700 1 -- 172.21.15.62:0/2271886403 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800ba20 con 0x7f96c4175590 2022-09-17T10:27:53.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96cbe37700 1 -- 172.21.15.62:0/2271886403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 msgr2=0x7f96c4180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:53.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96cbe37700 1 --2- 172.21.15.62:0/2271886403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 0x7f96c4180b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f96c4085780 tx=0x7f96b80090f0).stop 2022-09-17T10:27:53.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96cbe37700 1 -- 172.21.15.62:0/2271886403 shutdown_connections 2022-09-17T10:27:53.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96cbe37700 1 --2- 172.21.15.62:0/2271886403 >> v2:172.21.15.93:3300/0 conn(0x7f96c41751b0 0x7f96c4180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96cbe37700 1 --2- 172.21.15.62:0/2271886403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 0x7f96c4180b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96cbe37700 1 -- 172.21.15.62:0/2271886403 >> 172.21.15.62:0/2271886403 conn(0x7f96c406a170 msgr2=0x7f96c40f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:53.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96cbe37700 1 -- 172.21.15.62:0/2271886403 shutdown_connections 2022-09-17T10:27:53.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.078+0000 7f96cbe37700 1 -- 172.21.15.62:0/2271886403 wait complete. 2022-09-17T10:27:53.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.080+0000 7f96cbe37700 1 Processor -- start 2022-09-17T10:27:53.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.080+0000 7f96cbe37700 1 -- start start 2022-09-17T10:27:53.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96cbe37700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96c41751b0 0x7f96c41691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:53.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96cbe37700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 0x7f96c40cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:53.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96cbe37700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c4181050 0x7f96c40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:53.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96cbe37700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cc990 con 0x7f96c41751b0 2022-09-17T10:27:53.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96cbe37700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cb810 con 0x7f96c4181050 2022-09-17T10:27:53.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96cbe37700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cbaa0 con 0x7f96c4175590 2022-09-17T10:27:53.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96c41751b0 0x7f96c41691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:53.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96c41751b0 0x7f96c41691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37040/0 (socket says 172.21.15.62:37040) 2022-09-17T10:27:53.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 -- 172.21.15.62:0/4104291157 learned_addr learned my addr 172.21.15.62:0/4104291157 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:53.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c93d2700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 0x7f96c40cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:53.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96ca3d4700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c4181050 0x7f96c40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:53.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 -- 172.21.15.62:0/4104291157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 msgr2=0x7f96c40cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:53.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 0x7f96c40cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 -- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c4181050 msgr2=0x7f96c40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c4181050 0x7f96c40cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 -- 172.21.15.62:0/4104291157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b8009370 con 0x7f96c41751b0 2022-09-17T10:27:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c93d2700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 0x7f96c40cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96ca3d4700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c4181050 0x7f96c40cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c9bd3700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96c41751b0 0x7f96c41691a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f96bc009f10 tx=0x7f96bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:53.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.081+0000 7f96c1ffb700 1 -- 172.21.15.62:0/4104291157 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00cc80 con 0x7f96c41751b0 2022-09-17T10:27:53.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.082+0000 7f96c1ffb700 1 -- 172.21.15.62:0/4104291157 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00f040 con 0x7f96c41751b0 2022-09-17T10:27:53.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.082+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c40cbd80 con 0x7f96c41751b0 2022-09-17T10:27:53.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.082+0000 7f96c1ffb700 1 -- 172.21.15.62:0/4104291157 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc013400 con 0x7f96c41751b0 2022-09-17T10:27:53.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.082+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40cc340 con 0x7f96c41751b0 2022-09-17T10:27:53.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.083+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c40c4670 con 0x7f96c41751b0 2022-09-17T10:27:53.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.084+0000 7f96c1ffb700 1 -- 172.21.15.62:0/4104291157 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f96bc0137b0 con 0x7f96c41751b0 2022-09-17T10:27:53.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.084+0000 7f96c1ffb700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f96a408ba40 0x7f96a408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:53.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.084+0000 7f96c1ffb700 1 -- 172.21.15.62:0/4104291157 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f96bc0b1e60 con 0x7f96c41751b0 2022-09-17T10:27:53.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.084+0000 7f96c93d2700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f96a408ba40 0x7f96a408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:53.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.085+0000 7f96c93d2700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f96a408ba40 0x7f96a408df00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f96b800b2e0 tx=0x7f96b8017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:53.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.087+0000 7f96c1ffb700 1 -- 172.21.15.62:0/4104291157 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f96bc082b20 con 0x7f96c41751b0 2022-09-17T10:27:53.305 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.303+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96c406bf40 con 0x7f96c41751b0 2022-09-17T10:27:53.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.304+0000 7f96c1ffb700 1 -- 172.21.15.62:0/4104291157 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+10527 (secure 0 0 0) 0x7f96bc086140 con 0x7f96c41751b0 2022-09-17T10:27:53.306 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:53.307 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/2161434381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2161434381},{"type":"v1","addr":"172.21.15.62:6833","nonce":2161434381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/1194163827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1194163827},{"type":"v1","addr":"172.21.15.62:6839","nonce":1194163827}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/413826247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":413826247},{"type":"v1","addr":"172.21.15.93:6835","nonce":413826247}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4325,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3152394380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3152394380},{"type":"v1","addr":"172.21.15.159:6836","nonce":3152394380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2292269070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2292269070},{"type":"v1","addr":"172.21.15.62:6835","nonce":2292269070}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4327,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/301789402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":301789402},{"type":"v1","addr":"172.21.15.93:6837","nonce":301789402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4329,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1156565194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1156565194},{"type":"v1","addr":"172.21.15.62:6837","nonce":1156565194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4333,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6839/135709201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":135709201},{"type":"v1","addr":"172.21.15.93:6839","nonce":135709201}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4336,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6841/1241271614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6840","nonce":1241271614},{"type":"v1","addr":"172.21.15.93:6841","nonce":1241271614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/426632534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":426632534},{"type":"v1","addr":"172.21.15.159:6833","nonce":426632534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4360,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/574611303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":574611303},{"type":"v1","addr":"172.21.15.159:6839","nonce":574611303}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-09-17T10:27:42.793084+0000","modified":"2022-09-17T10:27:47.200107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/802951039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":802951039},{"type":"v1","addr":"172.21.15.159:6837","nonce":802951039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-09-17T10:27:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f96a408ba40 msgr2=0x7f96a408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f96a408ba40 0x7f96a408df00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f96b800b2e0 tx=0x7f96b8017000).stop 2022-09-17T10:27:53.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96c41751b0 msgr2=0x7f96c41691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:53.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96c41751b0 0x7f96c41691a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f96bc009f10 tx=0x7f96bc00b040).stop 2022-09-17T10:27:53.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 shutdown_connections 2022-09-17T10:27:53.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f96a408ba40 0x7f96a408df00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c4181050 0x7f96c40cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96c41751b0 0x7f96c41691a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 --2- 172.21.15.62:0/4104291157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c4175590 0x7f96c40cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:53.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 >> 172.21.15.62:0/4104291157 conn(0x7f96c406a170 msgr2=0x7f96c416f420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:53.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 shutdown_connections 2022-09-17T10:27:53.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:53.306+0000 7f96cbe37700 1 -- 172.21.15.62:0/4104291157 wait complete. 2022-09-17T10:27:53.311 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2022-09-17T10:27:53.935 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:27:53.940 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:27:53.943 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:27:54.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-09-17T10:27:42.793084+0000', 'modified': '2022-09-17T10:27:47.200107+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4365': {'gid': 4365, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6837/802951039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6835', 'nonce': 802951039}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 802951039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2022-09-17T10:27:54.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-09-17T10:27:54.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-09-17T10:27:54.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.659+0000 7f1ad138f700 1 Processor -- start 2022-09-17T10:27:54.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.659+0000 7f1ad138f700 1 -- start start 2022-09-17T10:27:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1ad138f700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1acc0f0d50 0x7f1acc0cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1ad138f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1acc0cb710 0x7f1acc0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1ad138f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc0cd060 con 0x7f1acc178940 2022-09-17T10:27:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1ad138f700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc17cc40 con 0x7f1acc0cb710 2022-09-17T10:27:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1ad138f700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc0cc170 con 0x7f1acc0f0d50 2022-09-17T10:27:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1acaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1acc178940 0x7f1acc17c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53054/0 (socket says 172.21.15.62:53054) 2022-09-17T10:27:54.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1acaffd700 1 -- 172.21.15.62:0/3600821928 learned_addr learned my addr 172.21.15.62:0/3600821928 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:54.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/3600821928 >> v2:172.21.15.93:3300/0 conn(0x7f1acc0cb710 0x7f1acc0cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/3600821928 >> v2:172.21.15.159:3300/0 conn(0x7f1acc0f0d50 0x7f1acc0cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.660+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/3600821928 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831205222 0 0) 0x7f1acc0cd060 con 0x7f1acc178940 2022-09-17T10:27:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/3600821928 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aac0033f0 con 0x7f1acc178940 2022-09-17T10:27:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1acb7fe700 1 -- 172.21.15.62:0/3600821928 >> v2:172.21.15.159:3300/0 conn(0x7f1acc0f0d50 msgr2=0x7f1acc0cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/3600821928 >> v2:172.21.15.159:3300/0 conn(0x7f1acc0f0d50 0x7f1acc0cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1acb7fe700 1 -- 172.21.15.62:0/3600821928 >> v1:172.21.15.62:6789/0 conn(0x7f1acc178940 legacy=0x7f1acc17c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.669 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1acb7fe700 1 -- 172.21.15.62:0/3600821928 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0cc450 con 0x7f1acc0cb710 2022-09-17T10:27:54.669 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/3600821928 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 0x7f1acc0cbba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f1acc17c4e0 tx=0x7f1abc009060).ready entity=mon.1 client_cookie=72cf55d148dcce5 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:54.669 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/3600821928 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00d4a0 con 0x7f1acc0cb710 2022-09-17T10:27:54.669 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/3600821928 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00d600 con 0x7f1acc0cb710 2022-09-17T10:27:54.669 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/3600821928 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00d980 con 0x7f1acc0cb710 2022-09-17T10:27:54.670 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1ad138f700 1 -- 172.21.15.62:0/3600821928 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 msgr2=0x7f1acc0cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.670 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.661+0000 7f1ad138f700 1 --2- 172.21.15.62:0/3600821928 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 0x7f1acc0cbba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f1acc17c4e0 tx=0x7f1abc009060).stop 2022-09-17T10:27:54.670 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.662+0000 7f1ad138f700 1 -- 172.21.15.62:0/3600821928 shutdown_connections 2022-09-17T10:27:54.670 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.662+0000 7f1ad138f700 1 --2- 172.21.15.62:0/3600821928 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 0x7f1acc0cbba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.671 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.662+0000 7f1ad138f700 1 --2- 172.21.15.62:0/3600821928 >> v2:172.21.15.159:3300/0 conn(0x7f1acc0f0d50 0x7f1acc0cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.671 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.662+0000 7f1ad138f700 1 -- 172.21.15.62:0/3600821928 >> 172.21.15.62:0/3600821928 conn(0x7f1acc06a170 msgr2=0x7f1acc0f4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:54.671 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.662+0000 7f1ad138f700 1 -- 172.21.15.62:0/3600821928 shutdown_connections 2022-09-17T10:27:54.671 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.662+0000 7f1ad138f700 1 -- 172.21.15.62:0/3600821928 wait complete. 2022-09-17T10:27:54.672 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.663+0000 7f1ad138f700 1 Processor -- start 2022-09-17T10:27:54.672 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.663+0000 7f1ad138f700 1 -- start start 2022-09-17T10:27:54.683 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1ad138f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 0x7f1acc18e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.684 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1ad138f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1acc0f0d50 0x7f1acc16ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.684 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1ad138f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc178940 0x7f1acc174410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.684 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1ad138f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc18ed00 con 0x7f1acc178940 2022-09-17T10:27:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1ad138f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc17cae0 con 0x7f1acc0cb710 2022-09-17T10:27:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1ad138f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc18f780 con 0x7f1acc0f0d50 2022-09-17T10:27:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc178940 0x7f1acc174410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc178940 0x7f1acc174410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42696/0 (socket says 172.21.15.62:42696) 2022-09-17T10:27:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1acb7fe700 1 -- 172.21.15.62:0/1110952384 learned_addr learned my addr 172.21.15.62:0/1110952384 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:54.686 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.664+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1acc0f0d50 0x7f1acc16ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.686 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1acaffd700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 0x7f1acc18e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.686 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1acb7fe700 1 -- 172.21.15.62:0/1110952384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1acc0f0d50 msgr2=0x7f1acc16ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.686 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1acc0f0d50 0x7f1acc16ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1acb7fe700 1 -- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 msgr2=0x7f1acc18e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 0x7f1acc18e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1acb7fe700 1 -- 172.21.15.62:0/1110952384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc0092a0 con 0x7f1acc178940 2022-09-17T10:27:54.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc178940 0x7f1acc174410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f1abc009d20 tx=0x7f1abc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:54.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1ac2ffd700 1 -- 172.21.15.62:0/1110952384 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc021070 con 0x7f1acc178940 2022-09-17T10:27:54.688 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1ad138f700 1 -- 172.21.15.62:0/1110952384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc0c5af0 con 0x7f1acc178940 2022-09-17T10:27:54.688 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1ad138f700 1 -- 172.21.15.62:0/1110952384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc0c57c0 con 0x7f1acc178940 2022-09-17T10:27:54.688 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1ac2ffd700 1 -- 172.21.15.62:0/1110952384 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00d770 con 0x7f1acc178940 2022-09-17T10:27:54.688 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.665+0000 7f1ac2ffd700 1 -- 172.21.15.62:0/1110952384 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00d4a0 con 0x7f1acc178940 2022-09-17T10:27:54.689 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.667+0000 7f1ac2ffd700 1 -- 172.21.15.62:0/1110952384 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f1abc00f070 con 0x7f1acc178940 2022-09-17T10:27:54.689 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.668+0000 7f1ac2ffd700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f1ab008ba40 0x7f1ab008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.689 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.668+0000 7f1ac2ffd700 1 -- 172.21.15.62:0/1110952384 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1abc0b1dd0 con 0x7f1acc178940 2022-09-17T10:27:54.689 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.668+0000 7f1acaffd700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f1ab008ba40 0x7f1ab008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.689 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.668+0000 7f1acaffd700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f1ab008ba40 0x7f1ab008df00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1acc1704b0 tx=0x7f1ac4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:54.690 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.669+0000 7f1ae2d1bb80 1 Processor -- start 2022-09-17T10:27:54.690 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.669+0000 7f1ae2d1bb80 1 -- start start 2022-09-17T10:27:54.690 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.670+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 0x556bea3d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.690 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.670+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e570 0x556bea41e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.691 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.670+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea3d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.691 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.670+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea312a50 con 0x556bea3d0340 2022-09-17T10:27:54.691 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.670+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea327900 con 0x556bea40e190 2022-09-17T10:27:54.691 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.670+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea2ef0d0 con 0x556bea40e570 2022-09-17T10:27:54.692 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea3d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.692 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea3d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42698/0 (socket says 172.21.15.62:42698) 2022-09-17T10:27:54.692 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 -- 172.21.15.62:0/2905217532 learned_addr learned my addr 172.21.15.62:0/2905217532 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:54.692 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acaffd700 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 0x556bea3d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.692 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e570 0x556bea41e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.693 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 -- 172.21.15.62:0/2905217532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e570 msgr2=0x556bea41e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.693 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e570 0x556bea41e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.693 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 -- 172.21.15.62:0/2905217532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 msgr2=0x556bea3d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.693 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 0x556bea3d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.694 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 -- 172.21.15.62:0/2905217532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bea3a7f70 con 0x556bea3d0340 2022-09-17T10:27:54.694 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea3d07c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1abc086320 tx=0x7f1abc006b10).ready entity=mon.0 client_cookie=b770b8cdb5299ee7 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:54.694 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1aabfff700 1 -- 172.21.15.62:0/2905217532 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc08c010 con 0x556bea3d0340 2022-09-17T10:27:54.694 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1aabfff700 1 -- 172.21.15.62:0/2905217532 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc084ad0 con 0x556bea3d0340 2022-09-17T10:27:54.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.671+0000 7f1aabfff700 1 -- 172.21.15.62:0/2905217532 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0af560 con 0x556bea3d0340 2022-09-17T10:27:54.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/2905217532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 msgr2=0x556bea3d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea3d07c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1abc086320 tx=0x7f1abc006b10).stop 2022-09-17T10:27:54.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/2905217532 shutdown_connections 2022-09-17T10:27:54.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 0x556bea3d21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.696 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea3d07c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.696 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/2905217532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e570 0x556bea41e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.696 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/2905217532 >> 172.21.15.62:0/2905217532 conn(0x556bea3d4dd0 msgr2=0x556bea3d57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:54.696 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/2905217532 shutdown_connections 2022-09-17T10:27:54.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.672+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/2905217532 wait complete. 2022-09-17T10:27:54.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.673+0000 7f1ae2d1bb80 1 -- start start 2022-09-17T10:27:54.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.673+0000 7f1ae2d1bb80 1 Processor -- start 2022-09-17T10:27:54.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea3d0340 0x556bea404d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea404250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea412f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea405890 con 0x556bea40e570 2022-09-17T10:27:54.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea414bc0 con 0x556bea3d0340 2022-09-17T10:27:54.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea413840 con 0x556bea40e190 2022-09-17T10:27:54.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1ae2d1bb80 10 client.0 ll_register_callbacks cb 0x556bea395360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-17T10:27:54.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea412f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea412f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42714/0 (socket says 172.21.15.62:42714) 2022-09-17T10:27:54.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acb7fe700 1 -- 172.21.15.62:0/4250813792 learned_addr learned my addr 172.21.15.62:0/4250813792 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:54.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acaffd700 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea3d0340 0x556bea404d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea404250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acb7fe700 1 -- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 msgr2=0x556bea404250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea404250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acb7fe700 1 -- 172.21.15.62:0/4250813792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea3d0340 msgr2=0x556bea404d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea3d0340 0x556bea404d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1acb7fe700 1 -- 172.21.15.62:0/4250813792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc0c57c0 con 0x556bea40e570 2022-09-17T10:27:54.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.674+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea404250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:54.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea412f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1abc01d020 tx=0x7f1abc089000).ready entity=mon.0 client_cookie=289b35132908cab server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:54.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1aa97fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2022-09-17T10:27:54.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1aa97fa700 1 -- 172.21.15.62:0/4250813792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc08c010 con 0x556bea40e570 2022-09-17T10:27:54.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1aa97fa700 1 -- 172.21.15.62:0/4250813792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1abc085e30 con 0x556bea40e570 2022-09-17T10:27:54.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/4250813792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bea3cf710 con 0x556bea40e570 2022-09-17T10:27:54.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1aa97fa700 1 -- 172.21.15.62:0/4250813792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1abc08bd90 con 0x556bea40e570 2022-09-17T10:27:54.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 10 client.4554 fetch_fsmap learned FSMap version 7 2022-09-17T10:27:54.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/4250813792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556bea159990 con 0x556bea40e570 2022-09-17T10:27:54.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1aa97fa700 1 -- 172.21.15.62:0/4250813792 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556bea3cf710 con 0x556bea40e570 2022-09-17T10:27:54.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1aa97fa700 1 -- 172.21.15.62:0/4250813792 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f1abc053ba0 con 0x556bea40e570 2022-09-17T10:27:54.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 10 client.4554 fetch_fsmap finished waiting for FSMap version 7 2022-09-17T10:27:54.704 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 10 client.4554 resolve_mds: resolved name 'f' to daemon mds.f 2022-09-17T10:27:54.704 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 20 client.4554 populate_metadata read hostname 'smithi062' 2022-09-17T10:27:54.704 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x556bea40d400 0x556bea402600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.704 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 4 client.4554 mds_command: new command op to 4365 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-17T10:27:54.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.675+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/4250813792 --> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bea31d7a0 con 0x556bea40d400 2022-09-17T10:27:54.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.676+0000 7f1acaffd700 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x556bea40d400 0x556bea402600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.676+0000 7f1aa97fa700 10 client.4554 ms_handle_connect on v2:172.21.15.159:6835/802951039 2022-09-17T10:27:54.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.676+0000 7f1acaffd700 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x556bea40d400 0x556bea402600 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5d908353fefb58da server_cookie=294d3ba675da1f4b in_seq=0 out_seq=0 2022-09-17T10:27:54.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1aa97fa700 1 -- 172.21.15.62:0/4250813792 <== mds.0 v2:172.21.15.159:6835/802951039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x556bea31d7a0 con 0x556bea40d400 2022-09-17T10:27:54.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1aa97fa700 10 client.4554 handle_command_reply: tid=0 2022-09-17T10:27:54.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 client.4554 shutdown 2022-09-17T10:27:54.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/4250813792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 msgr2=0x556bea412f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea412f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1abc01d020 tx=0x7f1abc089000).stop 2022-09-17T10:27:54.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/4250813792 shutdown_connections 2022-09-17T10:27:54.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea3d0340 0x556bea404d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x556bea40d400 0x556bea402600 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea412f00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/4250813792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea404250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1aa97fa700 0 client.4554 ms_handle_reset on v2:172.21.15.159:6835/802951039 2022-09-17T10:27:54.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/4250813792 >> 172.21.15.62:0/4250813792 conn(0x556bea3d4dd0 msgr2=0x556bea444fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:54.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/4250813792 shutdown_connections 2022-09-17T10:27:54.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/4250813792 wait complete. 2022-09-17T10:27:54.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.677+0000 7f1ae2d1bb80 20 client.4554 trim_cache size 0 max 16384 2022-09-17T10:27:54.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.694+0000 7f1ae2d1bb80 1 Processor -- start 2022-09-17T10:27:54.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.694+0000 7f1ae2d1bb80 1 -- start start 2022-09-17T10:27:54.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea3d0340 0x556bea43a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 0x556bea3daa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea3daf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea443d50 con 0x556bea40e570 2022-09-17T10:27:54.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea412bd0 con 0x556bea40e190 2022-09-17T10:27:54.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea3d1080 con 0x556bea3d0340 2022-09-17T10:27:54.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea3daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea3daf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42720/0 (socket says 172.21.15.62:42720) 2022-09-17T10:27:54.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 -- 172.21.15.62:0/3497037521 learned_addr learned my addr 172.21.15.62:0/3497037521 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:54.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acaffd700 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea3d0340 0x556bea43a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 -- 172.21.15.62:0/3497037521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea3d0340 msgr2=0x556bea43a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea3d0340 0x556bea43a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 0x556bea3daa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 -- 172.21.15.62:0/3497037521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 msgr2=0x556bea3daa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 0x556bea3daa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 -- 172.21.15.62:0/3497037521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bea1c8c80 con 0x556bea40e570 2022-09-17T10:27:54.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea3daf00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f1abc0865a0 tx=0x7f1abc08f000).ready entity=mon.0 client_cookie=dcbec0a9ebbe220f server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:54.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ac0ff9700 1 -- 172.21.15.62:0/3497037521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc08bd90 con 0x556bea40e570 2022-09-17T10:27:54.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ac0ff9700 1 -- 172.21.15.62:0/3497037521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc082a70 con 0x556bea40e570 2022-09-17T10:27:54.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.695+0000 7f1ac0ff9700 1 -- 172.21.15.62:0/3497037521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc08c010 con 0x556bea40e570 2022-09-17T10:27:54.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/3497037521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 msgr2=0x556bea3daf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea3daf00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f1abc0865a0 tx=0x7f1abc08f000).stop 2022-09-17T10:27:54.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/3497037521 shutdown_connections 2022-09-17T10:27:54.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea40e570 0x556bea3daf00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea3d0340 0x556bea43a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/3497037521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e190 0x556bea3daa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/3497037521 >> 172.21.15.62:0/3497037521 conn(0x556bea3d4dd0 msgr2=0x556bea444590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:54.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/3497037521 shutdown_connections 2022-09-17T10:27:54.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.696+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/3497037521 wait complete. 2022-09-17T10:27:54.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.697+0000 7f1ae2d1bb80 1 -- start start 2022-09-17T10:27:54.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.697+0000 7f1ae2d1bb80 1 Processor -- start 2022-09-17T10:27:54.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea412050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea3d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1ae2d1bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e570 0x556bea41c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea3d3990 con 0x556bea3d0340 2022-09-17T10:27:54.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea4025f0 con 0x556bea40e570 2022-09-17T10:27:54.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1ae2d1bb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bea3d2fe0 con 0x556bea40e190 2022-09-17T10:27:54.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1ae2d1bb80 10 client.0 ll_register_callbacks cb 0x556bea395360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-17T10:27:54.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea412050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea412050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42732/0 (socket says 172.21.15.62:42732) 2022-09-17T10:27:54.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 -- 172.21.15.62:0/1012896606 learned_addr learned my addr 172.21.15.62:0/1012896606 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:54.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea3d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 -- 172.21.15.62:0/1012896606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 msgr2=0x556bea3d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea3d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 -- 172.21.15.62:0/1012896606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e570 msgr2=0x556bea41c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:54.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acb7fe700 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e570 0x556bea41c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e570 0x556bea41c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 -- 172.21.15.62:0/1012896606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bea159990 con 0x556bea3d0340 2022-09-17T10:27:54.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1acaffd700 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea412050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1ac4001350 tx=0x7f1ac4015040).ready entity=mon.0 client_cookie=5b11174311d96660 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:54.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.698+0000 7f1aa97fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2022-09-17T10:27:54.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1aa97fa700 1 -- 172.21.15.62:0/1012896606 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400fe50 con 0x556bea3d0340 2022-09-17T10:27:54.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1aa97fa700 1 -- 172.21.15.62:0/1012896606 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1ac4013600 con 0x556bea3d0340 2022-09-17T10:27:54.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/1012896606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bea314640 con 0x556bea3d0340 2022-09-17T10:27:54.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1aa97fa700 1 -- 172.21.15.62:0/1012896606 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ac40139d0 con 0x556bea3d0340 2022-09-17T10:27:54.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 10 client.4560 fetch_fsmap learned FSMap version 7 2022-09-17T10:27:54.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/1012896606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556bea196f80 con 0x556bea3d0340 2022-09-17T10:27:54.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1aa97fa700 1 -- 172.21.15.62:0/1012896606 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556bea314640 con 0x556bea3d0340 2022-09-17T10:27:54.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1aa97fa700 1 -- 172.21.15.62:0/1012896606 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 7468+0+0 (secure 0 0 0) 0x7f1ac402b070 con 0x556bea3d0340 2022-09-17T10:27:54.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 10 client.4560 fetch_fsmap finished waiting for FSMap version 7 2022-09-17T10:27:54.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 10 client.4560 resolve_mds: resolved name 'f' to daemon mds.f 2022-09-17T10:27:54.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 20 client.4560 populate_metadata read hostname 'smithi062' 2022-09-17T10:27:54.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x556bea3db190 0x556bea3db570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:54.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 4 client.4560 mds_command: new command op to 4365 tid=0[{"prefix": "status"}] 2022-09-17T10:27:54.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/1012896606 --> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556bea17b390 con 0x556bea3db190 2022-09-17T10:27:54.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.699+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x556bea3db190 0x556bea3db570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:54.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1aa97fa700 10 client.4560 ms_handle_connect on v2:172.21.15.159:6835/802951039 2022-09-17T10:27:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1aca7fc700 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x556bea3db190 0x556bea3db570 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4a861b1c2aa47d22 server_cookie=6ded9a03dc804a29 in_seq=0 out_seq=0 2022-09-17T10:27:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1aa97fa700 1 -- 172.21.15.62:0/1012896606 <== mds.0 v2:172.21.15.159:6835/802951039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x556bea17b390 con 0x556bea3db190 2022-09-17T10:27:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1aa97fa700 10 client.4560 handle_command_reply: tid=0 2022-09-17T10:27:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 client.4560 shutdown 2022-09-17T10:27:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/1012896606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 msgr2=0x556bea412050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea412050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1ac4001350 tx=0x7f1ac4015040).stop 2022-09-17T10:27:54.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/1012896606 shutdown_connections 2022-09-17T10:27:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556bea40e570 0x556bea41c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x556bea3db190 0x556bea3db570 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bea3d0340 0x556bea412050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1aa97fa700 0 client.4560 ms_handle_reset on v2:172.21.15.159:6835/802951039 2022-09-17T10:27:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 --2- 172.21.15.62:0/1012896606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556bea40e190 0x556bea3d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/1012896606 >> 172.21.15.62:0/1012896606 conn(0x556bea3d4dd0 msgr2=0x556bea413980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/1012896606 shutdown_connections 2022-09-17T10:27:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.700+0000 7f1ae2d1bb80 1 -- 172.21.15.62:0/1012896606 wait complete. 2022-09-17T10:27:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ae2d1bb80 20 client.4560 trim_cache size 0 max 16384 2022-09-17T10:27:54.743 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2022-09-17T10:27:54.744 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "caff66e9-e5bf-4b11-8278-68b3c904b131", 2022-09-17T10:27:54.744 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2022-09-17T10:27:54.744 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4365, 2022-09-17T10:27:54.744 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2022-09-17T10:27:54.745 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2022-09-17T10:27:54.745 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2022-09-17T10:27:54.745 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 11.905750692, 2022-09-17T10:27:54.745 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 7, 2022-09-17T10:27:54.745 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 31, 2022-09-17T10:27:54.746 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 30, 2022-09-17T10:27:54.746 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 17.145952756 2022-09-17T10:27:54.746 INFO:teuthology.orchestra.run.smithi062.stdout:} 2022-09-17T10:27:54.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 -- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f1ab008ba40 msgr2=0x7f1ab008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f1ab008ba40 0x7f1ab008df00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1acc1704b0 tx=0x7f1ac4009040).stop 2022-09-17T10:27:54.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 -- 172.21.15.62:0/1110952384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc178940 msgr2=0x7f1acc174410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:54.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc178940 0x7f1acc174410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f1abc009d20 tx=0x7f1abc016000).stop 2022-09-17T10:27:54.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 -- 172.21.15.62:0/1110952384 shutdown_connections 2022-09-17T10:27:54.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f1ab008ba40 0x7f1ab008df00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1acc0cb710 0x7f1acc18e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc178940 0x7f1acc174410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 --2- 172.21.15.62:0/1110952384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1acc0f0d50 0x7f1acc16ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:54.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 -- 172.21.15.62:0/1110952384 >> 172.21.15.62:0/1110952384 conn(0x7f1acc06a170 msgr2=0x7f1acc1771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:54.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 -- 172.21.15.62:0/1110952384 shutdown_connections 2022-09-17T10:27:54.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:54.701+0000 7f1ad138f700 1 -- 172.21.15.62:0/1110952384 wait complete. 2022-09-17T10:27:54.751 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-09-17T10:27:54.751 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2022-09-17T10:27:54.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-09-17T10:27:54.753 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.admin 2022-09-17T10:27:54.771 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2022-09-17T10:27:54.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2022-09-17T10:27:54.836 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-09-17T10:27:54.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-09-17T10:27:54.901 INFO:teuthology.orchestra.run.smithi062.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-09-17T10:27:54.902 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-09-17T10:27:54.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-09-17T10:27:54.904 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2022-09-17T10:27:54.959 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-09-17T10:27:54.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id admin --client_fs=cephfs /home/ubuntu/cephtest/mnt.admin 2022-09-17T10:27:55.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2022-09-17T10:27:55.028 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-09-17T10:27:55.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-09-17T10:27:55.097 INFO:teuthology.orchestra.run.smithi062.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-09-17T10:27:55.098 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-09-17T10:27:55.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-09-17T10:27:55.100 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2022-09-17T10:27:55.109 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:2022-09-17T10:27:55.107+0000 7f8224786380 -1 init, newargv = 0x556a8f1ba270 newargc=15 2022-09-17T10:27:55.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[87140]: starting ceph client 2022-09-17T10:27:55.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[87140]: starting fuse 2022-09-17T10:27:55.125 INFO:teuthology.orchestra.run.smithi062.stdout:47 2022-09-17T10:27:55.126 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2022-09-17T10:27:55.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-09-17T10:27:55.127 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2022-09-17T10:27:55.127 DEBUG:teuthology.orchestra.run.smithi062:> import re 2022-09-17T10:27:55.128 DEBUG:teuthology.orchestra.run.smithi062:> import os 2022-09-17T10:27:55.128 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2022-09-17T10:27:55.129 DEBUG:teuthology.orchestra.run.smithi062:> 2022-09-17T10:27:55.129 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2022-09-17T10:27:55.129 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2022-09-17T10:27:55.130 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2022-09-17T10:27:55.130 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2022-09-17T10:27:55.131 DEBUG:teuthology.orchestra.run.smithi062:> 2022-09-17T10:27:55.131 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2022-09-17T10:27:55.131 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2022-09-17T10:27:55.132 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2022-09-17T10:27:55.133 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2022-09-17T10:27:55.133 DEBUG:teuthology.orchestra.run.smithi062:> 2022-09-17T10:27:55.134 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2022-09-17T10:27:55.134 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-09-17T10:27:55.135 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2022-09-17T10:27:55.135 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-09-17T10:27:55.135 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2022-09-17T10:27:55.136 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2022-09-17T10:27:55.136 DEBUG:teuthology.orchestra.run.smithi062:> return f 2022-09-17T10:27:55.137 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-09-17T10:27:55.137 DEBUG:teuthology.orchestra.run.smithi062:> 2022-09-17T10:27:55.138 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.admin")) 2022-09-17T10:27:55.138 DEBUG:teuthology.orchestra.run.smithi062:> ' 2022-09-17T10:27:55.248 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.admin.87140.asok 2022-09-17T10:27:55.433 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.87140.asok 2022-09-17T10:27:55.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-09-17T10:27:55.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.87140.asok status 2022-09-17T10:27:55.586 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2022-09-17T10:27:55.587 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2022-09-17T10:27:55.587 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "9f1013ad23aaca59f081f4d35bc048be3d0598b7", 2022-09-17T10:27:55.587 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 16.2.10-818-g9f1013ad (9f1013ad23aaca59f081f4d35bc048be3d0598b7) pacific (stable)", 2022-09-17T10:27:55.587 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "admin", 2022-09-17T10:27:55.588 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2022-09-17T10:27:55.588 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2022-09-17T10:27:55.588 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "87140", 2022-09-17T10:27:55.588 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2022-09-17T10:27:55.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2022-09-17T10:27:55.589 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2022-09-17T10:27:55.589 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2022-09-17T10:27:55.589 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4563, 2022-09-17T10:27:55.590 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2022-09-17T10:27:55.590 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2022-09-17T10:27:55.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2022-09-17T10:27:55.590 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 4563 2022-09-17T10:27:55.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2022-09-17T10:27:55.591 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2022-09-17T10:27:55.591 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2022-09-17T10:27:55.591 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2022-09-17T10:27:55.591 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3575177705 2022-09-17T10:27:55.592 INFO:teuthology.orchestra.run.smithi062.stdout: } 2022-09-17T10:27:55.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2022-09-17T10:27:55.592 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2022-09-17T10:27:55.593 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2022-09-17T10:27:55.593 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2022-09-17T10:27:55.593 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3575177705 2022-09-17T10:27:55.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2022-09-17T10:27:55.594 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.4563 192.168.0.1:0/3575177705", 2022-09-17T10:27:55.594 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.1:0/3575177705", 2022-09-17T10:27:55.595 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2022-09-17T10:27:55.595 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 7, 2022-09-17T10:27:55.595 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 31, 2022-09-17T10:27:55.595 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2022-09-17T10:27:55.596 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2022-09-17T10:27:55.596 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2022-09-17T10:27:55.596 INFO:teuthology.orchestra.run.smithi062.stdout:} 2022-09-17T10:27:55.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-09-17T10:27:55.598 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2022-09-17T10:27:55.599 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.admin 2022-09-17T10:27:55.616 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2022-09-17T10:27:55.617 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2022-09-17T10:27:55.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-09-17T10:27:55.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2022-09-17T10:27:55.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-09-17T10:27:55.684 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2022-09-17T10:27:55.781 INFO:teuthology.orchestra.run.smithi062.stdout:# file: . 2022-09-17T10:27:55.782 INFO:teuthology.orchestra.run.smithi062.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2022-09-17T10:27:55.782 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:55.783 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2022-09-17T10:27:55.784 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-09-17T10:27:55.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2022-09-17T10:27:55.821 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[87140]: fuse finished with error 0 and tester_r 0 2022-09-17T10:27:55.823 INFO:teuthology.orchestra.run:waiting for 900 2022-09-17T10:27:55.901 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2022-09-17T10:27:55.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:27:55.903 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2022-09-17T10:27:55.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:56.079 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.077+0000 7fa03d09d700 1 Processor -- start 2022-09-17T10:27:56.080 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.077+0000 7fa03d09d700 1 -- start start 2022-09-17T10:27:56.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.078+0000 7fa03d09d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa038174ff0 0x7fa038063d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.078+0000 7fa03d09d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa038175470 con 0x7fa03817d490 2022-09-17T10:27:56.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.078+0000 7fa03d09d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0380641f0 con 0x7fa038174c10 2022-09-17T10:27:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.078+0000 7fa03d09d700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03817c110 con 0x7fa038174ff0 2022-09-17T10:27:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa03759e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa03817d490 0x7fa03817d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53066/0 (socket says 172.21.15.62:53066) 2022-09-17T10:27:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa03759e700 1 -- 172.21.15.62:0/1725895691 learned_addr learned my addr 172.21.15.62:0/1725895691 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa03659c700 1 --2- 172.21.15.62:0/1725895691 >> v2:172.21.15.159:3300/0 conn(0x7fa038174ff0 0x7fa038063d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403341736 0 0) 0x7fa038175470 con 0x7fa03817d490 2022-09-17T10:27:56.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0180033f0 con 0x7fa03817d490 2022-09-17T10:27:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369414269 0 0) 0x7fa0380641f0 con 0x7fa038174c10 2022-09-17T10:27:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa038175470 con 0x7fa038174c10 2022-09-17T10:27:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2954467010 0 0) 0x7fa0180033f0 con 0x7fa03817d490 2022-09-17T10:27:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 >> v2:172.21.15.159:3300/0 conn(0x7fa038174ff0 msgr2=0x7fa038063d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 --2- 172.21.15.62:0/1725895691 >> v2:172.21.15.159:3300/0 conn(0x7fa038174ff0 0x7fa038063d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 >> v1:172.21.15.93:6789/0 conn(0x7fa038174c10 legacy=0x7fa0380635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03817c3f0 con 0x7fa03817d490 2022-09-17T10:27:56.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7fa0280017f0 con 0x7fa03817d490 2022-09-17T10:27:56.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 >> v1:172.21.15.62:6789/0 conn(0x7fa03817d490 legacy=0x7fa03817d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018003ac0 0x7fa018003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018004690 0x7fa018004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018005000 0x7fa01800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03817c110 con 0x7fa018004690 2022-09-17T10:27:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01800beb0 con 0x7fa018003ac0 2022-09-17T10:27:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01800c070 con 0x7fa018005000 2022-09-17T10:27:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa03659c700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018004690 0x7fa018004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.079+0000 7fa036d9d700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018003ac0 0x7fa018003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03759e700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018005000 0x7fa01800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03659c700 1 -- 172.21.15.62:0/1725895691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018005000 msgr2=0x7fa01800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03659c700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018005000 0x7fa01800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03659c700 1 -- 172.21.15.62:0/1725895691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018003ac0 msgr2=0x7fa018003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03659c700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018003ac0 0x7fa018003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03659c700 1 -- 172.21.15.62:0/1725895691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180033f0 con 0x7fa018004690 2022-09-17T10:27:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03759e700 1 -- 172.21.15.62:0/1725895691 reap_dead start 2022-09-17T10:27:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03659c700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018004690 0x7fa018004b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa020009a80 tx=0x7fa020009060).ready entity=mon.0 client_cookie=6fc6b4b77debde71 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020009430 con 0x7fa018004690 2022-09-17T10:27:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02000e640 con 0x7fa018004690 2022-09-17T10:27:56.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa035d9b700 1 -- 172.21.15.62:0/1725895691 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02000e9c0 con 0x7fa018004690 2022-09-17T10:27:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03d09d700 1 -- 172.21.15.62:0/1725895691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018004690 msgr2=0x7fa018004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03d09d700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018004690 0x7fa018004b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa020009a80 tx=0x7fa020009060).stop 2022-09-17T10:27:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03d09d700 1 -- 172.21.15.62:0/1725895691 shutdown_connections 2022-09-17T10:27:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03d09d700 1 --2- 172.21.15.62:0/1725895691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018004690 0x7fa018004b10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03d09d700 1 -- 172.21.15.62:0/1725895691 >> 172.21.15.62:0/1725895691 conn(0x7fa0380f4c90 msgr2=0x7fa0380f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.080+0000 7fa03d09d700 1 -- 172.21.15.62:0/1725895691 shutdown_connections 2022-09-17T10:27:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.081+0000 7fa03d09d700 1 -- 172.21.15.62:0/1725895691 wait complete. 2022-09-17T10:27:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.082+0000 7fa03d09d700 1 Processor -- start 2022-09-17T10:27:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.082+0000 7fa03d09d700 1 -- start start 2022-09-17T10:27:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03d09d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018004690 0x7fa03816a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.111 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03d09d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa038165a20 0x7fa03818fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.111 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03d09d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03818ff20 0x7fa038153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.111 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03d09d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038165590 con 0x7fa038165a20 2022-09-17T10:27:56.111 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03d09d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0381832f0 con 0x7fa018004690 2022-09-17T10:27:56.112 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03d09d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03816af40 con 0x7fa03818ff20 2022-09-17T10:27:56.112 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa038165a20 0x7fa03818fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.112 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa038165a20 0x7fa03818fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42748/0 (socket says 172.21.15.62:42748) 2022-09-17T10:27:56.112 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03659c700 1 -- 172.21.15.62:0/2929443196 learned_addr learned my addr 172.21.15.62:0/2929443196 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:56.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa036d9d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018004690 0x7fa03816a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03759e700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03818ff20 0x7fa038153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03659c700 1 -- 172.21.15.62:0/2929443196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03818ff20 msgr2=0x7fa038153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03659c700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03818ff20 0x7fa038153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03659c700 1 -- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018004690 msgr2=0x7fa03816a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03659c700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018004690 0x7fa03816a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa03659c700 1 -- 172.21.15.62:0/2929443196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03816b220 con 0x7fa038165a20 2022-09-17T10:27:56.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.083+0000 7fa036d9d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018004690 0x7fa03816a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.084+0000 7fa03659c700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa038165a20 0x7fa03818fa30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa02000e4b0 tx=0x7fa02001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.084+0000 7fa02effd700 1 -- 172.21.15.62:0/2929443196 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02000ed70 con 0x7fa038165a20 2022-09-17T10:27:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.084+0000 7fa02effd700 1 -- 172.21.15.62:0/2929443196 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02000e7b0 con 0x7fa038165a20 2022-09-17T10:27:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.084+0000 7fa02effd700 1 -- 172.21.15.62:0/2929443196 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020025440 con 0x7fa038165a20 2022-09-17T10:27:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.084+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03816b500 con 0x7fa038165a20 2022-09-17T10:27:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.084+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa038164f40 con 0x7fa038165a20 2022-09-17T10:27:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.085+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03806bf40 con 0x7fa038165a20 2022-09-17T10:27:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.085+0000 7fa02effd700 1 -- 172.21.15.62:0/2929443196 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fa02002b020 con 0x7fa038165a20 2022-09-17T10:27:56.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.086+0000 7fa02effd700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa01c08ba40 0x7fa01c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.086+0000 7fa02effd700 1 -- 172.21.15.62:0/2929443196 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa0200b2060 con 0x7fa038165a20 2022-09-17T10:27:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.086+0000 7fa036d9d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa01c08ba40 0x7fa01c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.087+0000 7fa036d9d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa01c08ba40 0x7fa01c08df00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fa030000f60 tx=0x7fa030009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.090+0000 7fa02effd700 1 -- 172.21.15.62:0/2929443196 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fa020082d20 con 0x7fa038165a20 2022-09-17T10:27:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.261+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa03817c6d0 con 0x7fa038165a20 2022-09-17T10:27:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.262+0000 7fa02effd700 1 -- 172.21.15.62:0/2929443196 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7fa020016020 con 0x7fa038165a20 2022-09-17T10:27:56.266 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:56.266 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa01c08ba40 msgr2=0x7fa01c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa01c08ba40 0x7fa01c08df00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fa030000f60 tx=0x7fa030009040).stop 2022-09-17T10:27:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa038165a20 msgr2=0x7fa03818fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa038165a20 0x7fa03818fa30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa02000e4b0 tx=0x7fa02001a000).stop 2022-09-17T10:27:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 shutdown_connections 2022-09-17T10:27:56.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa01c08ba40 0x7fa01c08df00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa018004690 0x7fa03816a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa03818ff20 0x7fa038153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 --2- 172.21.15.62:0/2929443196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa038165a20 0x7fa03818fa30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 >> 172.21.15.62:0/2929443196 conn(0x7fa0380f4c90 msgr2=0x7fa0380cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 shutdown_connections 2022-09-17T10:27:56.274 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.264+0000 7fa03d09d700 1 -- 172.21.15.62:0/2929443196 wait complete. 2022-09-17T10:27:56.279 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:27:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.394+0000 7fc964077700 1 Processor -- start 2022-09-17T10:27:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.394+0000 7fc964077700 1 -- start start 2022-09-17T10:27:56.400 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc964077700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc95c062950 0x7fc95c062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc964077700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c0c6dd0 con 0x7fc95c1751b0 2022-09-17T10:27:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc964077700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c0642c0 con 0x7fc95c175590 2022-09-17T10:27:56.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc964077700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95c0f10e0 con 0x7fc95c062950 2022-09-17T10:27:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc961e13700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc95c1751b0 0x7fc95c180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53078/0 (socket says 172.21.15.62:53078) 2022-09-17T10:27:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc961e13700 1 -- 172.21.15.62:0/206711035 learned_addr learned my addr 172.21.15.62:0/206711035 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:27:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc962614700 1 --2- 172.21.15.62:0/206711035 >> v2:172.21.15.93:3300/0 conn(0x7fc95c062950 0x7fc95c062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970729490 0 0) 0x7fc95c0c6dd0 con 0x7fc95c1751b0 2022-09-17T10:27:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9480033f0 con 0x7fc95c1751b0 2022-09-17T10:27:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150593051 0 0) 0x7fc950001110 con 0x7fc95c175590 2022-09-17T10:27:56.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc95c0c6dd0 con 0x7fc95c175590 2022-09-17T10:27:56.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3939029713 0 0) 0x7fc9480033f0 con 0x7fc95c1751b0 2022-09-17T10:27:56.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 >> v2:172.21.15.93:3300/0 conn(0x7fc95c062950 msgr2=0x7fc95c062dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:56.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.395+0000 7fc960e11700 1 --2- 172.21.15.62:0/206711035 >> v2:172.21.15.93:3300/0 conn(0x7fc95c062950 0x7fc95c062dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 >> v1:172.21.15.159:6789/0 conn(0x7fc95c175590 legacy=0x7fc95c180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c1801e0 con 0x7fc95c1751b0 2022-09-17T10:27:56.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7fc94c0017f0 con 0x7fc95c1751b0 2022-09-17T10:27:56.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 >> v1:172.21.15.62:6789/0 conn(0x7fc95c1751b0 legacy=0x7fc95c180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc948003ac0 0x7fc948003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc948004690 0x7fc948004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948005070 0x7fc94800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0f10e0 con 0x7fc948004690 2022-09-17T10:27:56.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94800c010 con 0x7fc948003ac0 2022-09-17T10:27:56.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94800c1d0 con 0x7fc948005070 2022-09-17T10:27:56.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961612700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc948004690 0x7fc948004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961e13700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc948003ac0 0x7fc948003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc962614700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948005070 0x7fc94800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961612700 1 -- 172.21.15.62:0/206711035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948005070 msgr2=0x7fc94800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961612700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948005070 0x7fc94800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961612700 1 -- 172.21.15.62:0/206711035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc948003ac0 msgr2=0x7fc948003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961612700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc948003ac0 0x7fc948003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961612700 1 -- 172.21.15.62:0/206711035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480033f0 con 0x7fc948004690 2022-09-17T10:27:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc962614700 1 -- 172.21.15.62:0/206711035 reap_dead start 2022-09-17T10:27:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961e13700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc948003ac0 0x7fc948003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:27:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc961612700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc948004690 0x7fc948004b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc950001a20 tx=0x7fc950007bb0).ready entity=mon.0 client_cookie=f57cb37d45e8e8b9 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950007020 con 0x7fc948004690 2022-09-17T10:27:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc950007180 con 0x7fc948004690 2022-09-17T10:27:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.396+0000 7fc960e11700 1 -- 172.21.15.62:0/206711035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950007520 con 0x7fc948004690 2022-09-17T10:27:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.397+0000 7fc964077700 1 -- 172.21.15.62:0/206711035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc948004690 msgr2=0x7fc948004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.397+0000 7fc964077700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc948004690 0x7fc948004b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc950001a20 tx=0x7fc950007bb0).stop 2022-09-17T10:27:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.397+0000 7fc964077700 1 -- 172.21.15.62:0/206711035 shutdown_connections 2022-09-17T10:27:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.397+0000 7fc964077700 1 --2- 172.21.15.62:0/206711035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc948004690 0x7fc948004b10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.397+0000 7fc964077700 1 -- 172.21.15.62:0/206711035 >> 172.21.15.62:0/206711035 conn(0x7fc95c06a170 msgr2=0x7fc95c0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.397+0000 7fc964077700 1 -- 172.21.15.62:0/206711035 shutdown_connections 2022-09-17T10:27:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.397+0000 7fc964077700 1 -- 172.21.15.62:0/206711035 wait complete. 2022-09-17T10:27:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.398+0000 7fc964077700 1 Processor -- start 2022-09-17T10:27:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.398+0000 7fc964077700 1 -- start start 2022-09-17T10:27:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc964077700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948004690 0x7fc95c083de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc964077700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc95c0842d0 0x7fc95c16dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc964077700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc95c16e1b0 0x7fc95c179b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc964077700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0f0660 con 0x7fc95c16e1b0 2022-09-17T10:27:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc964077700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c084da0 con 0x7fc95c0842d0 2022-09-17T10:27:56.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc964077700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c179700 con 0x7fc948004690 2022-09-17T10:27:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc962614700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc95c16e1b0 0x7fc95c179b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc962614700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc95c16e1b0 0x7fc95c179b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42764/0 (socket says 172.21.15.62:42764) 2022-09-17T10:27:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.399+0000 7fc962614700 1 -- 172.21.15.62:0/3487447487 learned_addr learned my addr 172.21.15.62:0/3487447487 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:56.418 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc961e13700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948004690 0x7fc95c083de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc961612700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc95c0842d0 0x7fc95c16dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc962614700 1 -- 172.21.15.62:0/3487447487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948004690 msgr2=0x7fc95c083de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc962614700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948004690 0x7fc95c083de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.419 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc962614700 1 -- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc95c0842d0 msgr2=0x7fc95c16dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc962614700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc95c0842d0 0x7fc95c16dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc962614700 1 -- 172.21.15.62:0/3487447487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c0847e0 con 0x7fc95c16e1b0 2022-09-17T10:27:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc962614700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc95c16e1b0 0x7fc95c179b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fc954006d80 tx=0x7fc954009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.420 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc959ffb700 1 -- 172.21.15.62:0/3487447487 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400f730 con 0x7fc95c16e1b0 2022-09-17T10:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc959ffb700 1 -- 172.21.15.62:0/3487447487 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95400f890 con 0x7fc95c16e1b0 2022-09-17T10:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c084ac0 con 0x7fc95c16e1b0 2022-09-17T10:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc959ffb700 1 -- 172.21.15.62:0/3487447487 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400fc30 con 0x7fc95c16e1b0 2022-09-17T10:27:56.421 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.400+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c179390 con 0x7fc95c16e1b0 2022-09-17T10:27:56.422 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.401+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c178f10 con 0x7fc95c16e1b0 2022-09-17T10:27:56.422 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.402+0000 7fc959ffb700 1 -- 172.21.15.62:0/3487447487 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc954024070 con 0x7fc95c16e1b0 2022-09-17T10:27:56.422 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.403+0000 7fc959ffb700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc93c08ba10 0x7fc93c08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.422 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.403+0000 7fc959ffb700 1 -- 172.21.15.62:0/3487447487 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc9540b1000 con 0x7fc95c16e1b0 2022-09-17T10:27:56.422 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.403+0000 7fc961e13700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc93c08ba10 0x7fc93c08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.403+0000 7fc961e13700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc93c08ba10 0x7fc93c08ded0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc94c0011d0 tx=0x7fc95c180150).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.407+0000 7fc959ffb700 1 -- 172.21.15.62:0/3487447487 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fc95c178f10 con 0x7fc95c16e1b0 2022-09-17T10:27:56.582 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.580+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc95c178ee0 con 0x7fc95c16e1b0 2022-09-17T10:27:56.583 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.582+0000 7fc959ffb700 1 -- 172.21.15.62:0/3487447487 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7fc954018030 con 0x7fc95c16e1b0 2022-09-17T10:27:56.584 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:27:56.584 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:27:56.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.583+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc93c08ba10 msgr2=0x7fc93c08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.583+0000 7fc964077700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc93c08ba10 0x7fc93c08ded0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc94c0011d0 tx=0x7fc95c180150).stop 2022-09-17T10:27:56.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.583+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc95c16e1b0 msgr2=0x7fc95c179b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.583+0000 7fc964077700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc95c16e1b0 0x7fc95c179b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fc954006d80 tx=0x7fc954009060).stop 2022-09-17T10:27:56.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.583+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 shutdown_connections 2022-09-17T10:27:56.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.583+0000 7fc964077700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc93c08ba10 0x7fc93c08ded0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.583+0000 7fc964077700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc95c16e1b0 0x7fc95c179b90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.583+0000 7fc964077700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc948004690 0x7fc95c083de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.584+0000 7fc964077700 1 --2- 172.21.15.62:0/3487447487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc95c0842d0 0x7fc95c16dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.584+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 >> 172.21.15.62:0/3487447487 conn(0x7fc95c06a170 msgr2=0x7fc95c062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:56.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.584+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 shutdown_connections 2022-09-17T10:27:56.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.584+0000 7fc964077700 1 -- 172.21.15.62:0/3487447487 wait complete. 2022-09-17T10:27:56.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-09-17T10:27:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.718+0000 7fc6e635e700 1 Processor -- start 2022-09-17T10:27:56.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.718+0000 7fc6e635e700 1 -- start start 2022-09-17T10:27:56.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6e635e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6e017df60 0x7fc6e0085d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6e635e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e00858e0 con 0x7fc6e017e340 2022-09-17T10:27:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6e635e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e0084a30 con 0x7fc6e017fc50 2022-09-17T10:27:56.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6e635e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e0084cd0 con 0x7fc6e017df60 2022-09-17T10:27:56.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6dffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6e017df60 0x7fc6e0085d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6dffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6e017df60 0x7fc6e0085d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42770/0 (socket says 172.21.15.62:42770) 2022-09-17T10:27:56.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6df7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc6e017e340 0x7fc6e017f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53082/0 (socket says 172.21.15.62:53082) 2022-09-17T10:27:56.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6dffff700 1 -- 172.21.15.62:0/2821842216 learned_addr learned my addr 172.21.15.62:0/2821842216 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:56.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6dffff700 1 -- 172.21.15.62:0/2821842216 >> v1:172.21.15.93:6789/0 conn(0x7fc6e017fc50 legacy=0x7fc6e00ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6dffff700 1 -- 172.21.15.62:0/2821842216 >> v1:172.21.15.62:6789/0 conn(0x7fc6e017e340 legacy=0x7fc6e017f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6deffd700 1 -- 172.21.15.62:0/2821842216 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154185773 0 0) 0x7fc6e00858e0 con 0x7fc6e017e340 2022-09-17T10:27:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6dffff700 1 -- 172.21.15.62:0/2821842216 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0084fb0 con 0x7fc6e017df60 2022-09-17T10:27:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6dffff700 1 --2- 172.21.15.62:0/2821842216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017df60 0x7fc6e0085d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc6c8006fd0 tx=0x7fc6c80090f0).ready entity=mon.0 client_cookie=1774163baeef7b0e server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6deffd700 1 -- 172.21.15.62:0/2821842216 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800b600 con 0x7fc6e017df60 2022-09-17T10:27:56.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6deffd700 1 -- 172.21.15.62:0/2821842216 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c800b760 con 0x7fc6e017df60 2022-09-17T10:27:56.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.719+0000 7fc6deffd700 1 -- 172.21.15.62:0/2821842216 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800bae0 con 0x7fc6e017df60 2022-09-17T10:27:56.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.720+0000 7fc6e635e700 1 -- 172.21.15.62:0/2821842216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017df60 msgr2=0x7fc6e0085d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.720+0000 7fc6e635e700 1 --2- 172.21.15.62:0/2821842216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017df60 0x7fc6e0085d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc6c8006fd0 tx=0x7fc6c80090f0).stop 2022-09-17T10:27:56.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.720+0000 7fc6e635e700 1 -- 172.21.15.62:0/2821842216 shutdown_connections 2022-09-17T10:27:56.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.720+0000 7fc6e635e700 1 --2- 172.21.15.62:0/2821842216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017df60 0x7fc6e0085d70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.720+0000 7fc6e635e700 1 -- 172.21.15.62:0/2821842216 >> 172.21.15.62:0/2821842216 conn(0x7fc6e00f2aa0 msgr2=0x7fc6e00f2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:56.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.720+0000 7fc6e635e700 1 -- 172.21.15.62:0/2821842216 shutdown_connections 2022-09-17T10:27:56.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.720+0000 7fc6e635e700 1 -- 172.21.15.62:0/2821842216 wait complete. 2022-09-17T10:27:56.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.721+0000 7fc6e635e700 1 Processor -- start 2022-09-17T10:27:56.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.722+0000 7fc6e635e700 1 -- start start 2022-09-17T10:27:56.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e635e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e017df60 0x7fc6e0153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e635e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6e017e340 0x7fc6e018ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e635e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017fc50 0x7fc6e0190400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e635e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0191bb0 con 0x7fc6e017fc50 2022-09-17T10:27:56.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e635e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0190cc0 con 0x7fc6e017e340 2022-09-17T10:27:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e635e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0190fa0 con 0x7fc6e017df60 2022-09-17T10:27:56.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017fc50 0x7fc6e0190400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017fc50 0x7fc6e0190400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42776/0 (socket says 172.21.15.62:42776) 2022-09-17T10:27:56.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 -- 172.21.15.62:0/1105931093 learned_addr learned my addr 172.21.15.62:0/1105931093 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:56.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6df7fe700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6e017e340 0x7fc6e018ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6dffff700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e017df60 0x7fc6e0153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 -- 172.21.15.62:0/1105931093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e017df60 msgr2=0x7fc6e0153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e017df60 0x7fc6e0153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 -- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6e017e340 msgr2=0x7fc6e018ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:56.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6e017e340 0x7fc6e018ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:56.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 -- 172.21.15.62:0/1105931093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009370 con 0x7fc6e017fc50 2022-09-17T10:27:56.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e48fb700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017fc50 0x7fc6e0190400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc6d800c7c0 tx=0x7fc6d8001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6d7fff700 1 -- 172.21.15.62:0/1105931093 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8010510 con 0x7fc6e017fc50 2022-09-17T10:27:56.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6d7fff700 1 -- 172.21.15.62:0/1105931093 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8010670 con 0x7fc6e017fc50 2022-09-17T10:27:56.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6d7fff700 1 -- 172.21.15.62:0/1105931093 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80109f0 con 0x7fc6e017fc50 2022-09-17T10:27:56.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0191280 con 0x7fc6e017fc50 2022-09-17T10:27:56.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.723+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e0191840 con 0x7fc6e017fc50 2022-09-17T10:27:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.724+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e006bf40 con 0x7fc6e017fc50 2022-09-17T10:27:56.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.725+0000 7fc6d7fff700 1 -- 172.21.15.62:0/1105931093 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc6d8010070 con 0x7fc6e017fc50 2022-09-17T10:27:56.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.726+0000 7fc6d7fff700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc6c408ba40 0x7fc6c408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:56.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.726+0000 7fc6d7fff700 1 -- 172.21.15.62:0/1105931093 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc6d80b05d0 con 0x7fc6e017fc50 2022-09-17T10:27:56.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.726+0000 7fc6dffff700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc6c408ba40 0x7fc6c408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:56.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.727+0000 7fc6dffff700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc6c408ba40 0x7fc6c408df00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc6c8009130 tx=0x7fc6c8017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:56.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.730+0000 7fc6d7fff700 1 -- 172.21.15.62:0/1105931093 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fc6d8081210 con 0x7fc6e017fc50 2022-09-17T10:27:56.950 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:56.947+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc6e0191cf0 con 0x7fc6e017fc50 2022-09-17T10:27:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.954+0000 7fc6d7fff700 1 -- 172.21.15.62:0/1105931093 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc6d8084830 con 0x7fc6e017fc50 2022-09-17T10:27:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.956+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc6c408ba40 msgr2=0x7fc6c408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.956+0000 7fc6e635e700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc6c408ba40 0x7fc6c408df00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc6c8009130 tx=0x7fc6c8017000).stop 2022-09-17T10:27:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017fc50 msgr2=0x7fc6e0190400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:57.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017fc50 0x7fc6e0190400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc6d800c7c0 tx=0x7fc6d8001510).stop 2022-09-17T10:27:57.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 shutdown_connections 2022-09-17T10:27:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc6c408ba40 0x7fc6c408df00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e017fc50 0x7fc6e0190400 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e017df60 0x7fc6e0153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:57.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 --2- 172.21.15.62:0/1105931093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6e017e340 0x7fc6e018ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 >> 172.21.15.62:0/1105931093 conn(0x7fc6e00f2aa0 msgr2=0x7fc6e0178270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 shutdown_connections 2022-09-17T10:27:57.962 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:57.957+0000 7fc6e635e700 1 -- 172.21.15.62:0/1105931093 wait complete. 2022-09-17T10:27:57.973 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2022-09-17T10:27:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.098+0000 7fc161d41700 1 Processor -- start 2022-09-17T10:27:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.098+0000 7fc161d41700 1 -- start start 2022-09-17T10:27:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc161d41700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc15c177b80 0x7fc15c178010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc161d41700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc15c0ed3f0 0x7fc15c17c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc161d41700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15c069e00 con 0x7fc15c1777a0 2022-09-17T10:27:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc161d41700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15c06a0e0 con 0x7fc15c0ed3f0 2022-09-17T10:27:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc161d41700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15c06a3c0 con 0x7fc15c177b80 2022-09-17T10:27:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc15bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc15c0ed3f0 0x7fc15c17c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc15bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc15c0ed3f0 0x7fc15c17c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42786/0 (socket says 172.21.15.62:42786) 2022-09-17T10:27:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc15bfff700 1 -- 172.21.15.62:0/1467326039 learned_addr learned my addr 172.21.15.62:0/1467326039 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.099+0000 7fc15affd700 1 --2- 172.21.15.62:0/1467326039 >> v2:172.21.15.159:3300/0 conn(0x7fc15c177b80 0x7fc15c178010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc15bfff700 1 -- 172.21.15.62:0/1467326039 >> v2:172.21.15.159:3300/0 conn(0x7fc15c177b80 msgr2=0x7fc15c178010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc15bfff700 1 --2- 172.21.15.62:0/1467326039 >> v2:172.21.15.159:3300/0 conn(0x7fc15c177b80 0x7fc15c178010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc15bfff700 1 -- 172.21.15.62:0/1467326039 >> v1:172.21.15.93:6789/0 conn(0x7fc15c1777a0 legacy=0x7fc15c17e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc15bfff700 1 -- 172.21.15.62:0/1467326039 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c17c080 con 0x7fc15c0ed3f0 2022-09-17T10:27:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc15bfff700 1 --2- 172.21.15.62:0/1467326039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c0ed3f0 0x7fc15c17c860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fc15c0f0560 tx=0x7fc154009840).ready entity=mon.0 client_cookie=a892c833d6e2f37d server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc15a7fc700 1 -- 172.21.15.62:0/1467326039 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400e070 con 0x7fc15c0ed3f0 2022-09-17T10:27:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc15a7fc700 1 -- 172.21.15.62:0/1467326039 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400ba50 con 0x7fc15c0ed3f0 2022-09-17T10:27:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc15a7fc700 1 -- 172.21.15.62:0/1467326039 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400bdd0 con 0x7fc15c0ed3f0 2022-09-17T10:27:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc161d41700 1 -- 172.21.15.62:0/1467326039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c0ed3f0 msgr2=0x7fc15c17c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc161d41700 1 --2- 172.21.15.62:0/1467326039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c0ed3f0 0x7fc15c17c860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fc15c0f0560 tx=0x7fc154009840).stop 2022-09-17T10:27:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc161d41700 1 -- 172.21.15.62:0/1467326039 shutdown_connections 2022-09-17T10:27:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc161d41700 1 --2- 172.21.15.62:0/1467326039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c0ed3f0 0x7fc15c17c860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc161d41700 1 --2- 172.21.15.62:0/1467326039 >> v2:172.21.15.159:3300/0 conn(0x7fc15c177b80 0x7fc15c178010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.100+0000 7fc161d41700 1 -- 172.21.15.62:0/1467326039 >> 172.21.15.62:0/1467326039 conn(0x7fc15c05d9a0 msgr2=0x7fc15c05ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:58.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.101+0000 7fc161d41700 1 -- 172.21.15.62:0/1467326039 shutdown_connections 2022-09-17T10:27:58.118 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.101+0000 7fc161d41700 1 -- 172.21.15.62:0/1467326039 wait complete. 2022-09-17T10:27:58.118 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.102+0000 7fc161d41700 1 Processor -- start 2022-09-17T10:27:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.102+0000 7fc161d41700 1 -- start start 2022-09-17T10:27:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc161d41700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc15c0ed3f0 0x7fc15c1710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc161d41700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c1777a0 0x7fc15c16bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc161d41700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc15c177b80 0x7fc15c1750b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc161d41700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c170c10 con 0x7fc15c1777a0 2022-09-17T10:27:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc161d41700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c16fd20 con 0x7fc15c0ed3f0 2022-09-17T10:27:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc161d41700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c170000 con 0x7fc15c177b80 2022-09-17T10:27:58.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc15affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c1777a0 0x7fc15c16bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:58.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc15affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c1777a0 0x7fc15c16bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42788/0 (socket says 172.21.15.62:42788) 2022-09-17T10:27:58.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc15affd700 1 -- 172.21.15.62:0/2425963011 learned_addr learned my addr 172.21.15.62:0/2425963011 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:58.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.103+0000 7fc15b7fe700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc15c0ed3f0 0x7fc15c1710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:58.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc15bfff700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc15c177b80 0x7fc15c1750b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:58.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc15affd700 1 -- 172.21.15.62:0/2425963011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc15c177b80 msgr2=0x7fc15c1750b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:58.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc15affd700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc15c177b80 0x7fc15c1750b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc15affd700 1 -- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc15c0ed3f0 msgr2=0x7fc15c1710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:58.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc15affd700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc15c0ed3f0 0x7fc15c1710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc15affd700 1 -- 172.21.15.62:0/2425963011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009ae0 con 0x7fc15c1777a0 2022-09-17T10:27:58.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc15bfff700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc15c177b80 0x7fc15c1750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:27:58.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc15affd700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c1777a0 0x7fc15c16bbf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc15000d890 tx=0x7fc150008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:58.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc1437fe700 1 -- 172.21.15.62:0/2425963011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1500125f0 con 0x7fc15c1777a0 2022-09-17T10:27:58.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc1437fe700 1 -- 172.21.15.62:0/2425963011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc150012750 con 0x7fc15c1777a0 2022-09-17T10:27:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15c1702e0 con 0x7fc15c1777a0 2022-09-17T10:27:58.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc1437fe700 1 -- 172.21.15.62:0/2425963011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150012ad0 con 0x7fc15c1777a0 2022-09-17T10:27:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.104+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c1708a0 con 0x7fc15c1777a0 2022-09-17T10:27:58.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.105+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15c06bf40 con 0x7fc15c1777a0 2022-09-17T10:27:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.106+0000 7fc1437fe700 1 -- 172.21.15.62:0/2425963011 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc150013480 con 0x7fc15c1777a0 2022-09-17T10:27:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.106+0000 7fc1437fe700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc13c08ba40 0x7fc13c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:58.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.106+0000 7fc1437fe700 1 -- 172.21.15.62:0/2425963011 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc1500b11f0 con 0x7fc15c1777a0 2022-09-17T10:27:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.107+0000 7fc15b7fe700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc13c08ba40 0x7fc13c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:58.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.107+0000 7fc15b7fe700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc13c08ba40 0x7fc13c08df00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc14c000c00 tx=0x7fc14c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:58.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.110+0000 7fc1437fe700 1 -- 172.21.15.62:0/2425963011 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fc150081f40 con 0x7fc15c1777a0 2022-09-17T10:27:58.329 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.327+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fc15c0c29b0 con 0x7fc15c1777a0 2022-09-17T10:27:58.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.959+0000 7fc1437fe700 1 -- 172.21.15.62:0/2425963011 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc150085560 con 0x7fc15c1777a0 2022-09-17T10:27:58.964 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc13c08ba40 msgr2=0x7fc13c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:58.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc13c08ba40 0x7fc13c08df00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc14c000c00 tx=0x7fc14c009040).stop 2022-09-17T10:27:58.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c1777a0 msgr2=0x7fc15c16bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:58.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c1777a0 0x7fc15c16bbf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc15000d890 tx=0x7fc150008040).stop 2022-09-17T10:27:58.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 shutdown_connections 2022-09-17T10:27:58.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc13c08ba40 0x7fc13c08df00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc15c0ed3f0 0x7fc15c1710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc15c177b80 0x7fc15c1750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 --2- 172.21.15.62:0/2425963011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc15c1777a0 0x7fc15c16bbf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:58.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 >> 172.21.15.62:0/2425963011 conn(0x7fc15c05d9a0 msgr2=0x7fc15c0eb660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:58.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 shutdown_connections 2022-09-17T10:27:58.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:58.961+0000 7fc161d41700 1 -- 172.21.15.62:0/2425963011 wait complete. 2022-09-17T10:27:58.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2022-09-17T10:27:59.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.099+0000 7fb4c25e7700 1 Processor -- start 2022-09-17T10:27:59.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.099+0000 7fb4c25e7700 1 -- start start 2022-09-17T10:27:59.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.100+0000 7fb4c25e7700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4bc0ebe30 0x7fb4bc0ec290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:59.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.100+0000 7fb4c25e7700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb4bc17f910 0x7fb4bc17fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:59.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.100+0000 7fb4c25e7700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0eb9a0 con 0x7fb4bc174e80 2022-09-17T10:27:59.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.100+0000 7fb4c25e7700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc0ec780 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.100+0000 7fb4c25e7700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b5d60 con 0x7fb4bc17f910 2022-09-17T10:27:59.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c0de4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4bc0ebe30 0x7fb4bc0ec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:59.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c1de6700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb4bc17f910 0x7fb4bc17fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:59.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c0de4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4bc0ebe30 0x7fb4bc0ec290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.62:51684/0 (socket says 172.21.15.62:51684) 2022-09-17T10:27:59.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c0de4700 1 -- 172.21.15.62:0/2438850833 learned_addr learned my addr 172.21.15.62:0/2438850833 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:59.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c15e5700 1 --1- 172.21.15.62:0/2438850833 >> v1:172.21.15.159:6789/0 conn(0x7fb4bc174e80 0x7fb4bc0b5650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.62:39396/0 (socket says 172.21.15.62:39396) 2022-09-17T10:27:59.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c0de4700 1 -- 172.21.15.62:0/2438850833 >> v2:172.21.15.159:3300/0 conn(0x7fb4bc17f910 msgr2=0x7fb4bc17fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:27:59.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c0de4700 1 --2- 172.21.15.62:0/2438850833 >> v2:172.21.15.159:3300/0 conn(0x7fb4bc17f910 0x7fb4bc17fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c0de4700 1 -- 172.21.15.62:0/2438850833 >> v1:172.21.15.159:6789/0 conn(0x7fb4bc174e80 legacy=0x7fb4bc0b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:59.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4bbfff700 1 -- 172.21.15.62:0/2438850833 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518730252 0 0) 0x7fb4bc0eb9a0 con 0x7fb4bc174e80 2022-09-17T10:27:59.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c0de4700 1 -- 172.21.15.62:0/2438850833 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0eaab0 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4c0de4700 1 --2- 172.21.15.62:0/2438850833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc0ec290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb4bc0cb5f0 tx=0x7fb4b00090f0).ready entity=mon.1 client_cookie=4aafc49f086d862b server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:59.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4bbfff700 1 -- 172.21.15.62:0/2438850833 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000b520 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4bbfff700 1 -- 172.21.15.62:0/2438850833 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b000b680 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.101+0000 7fb4bbfff700 1 -- 172.21.15.62:0/2438850833 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000ba00 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.102+0000 7fb4c25e7700 1 -- 172.21.15.62:0/2438850833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc0ebe30 msgr2=0x7fb4bc0ec290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:59.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.102+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/2438850833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc0ec290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb4bc0cb5f0 tx=0x7fb4b00090f0).stop 2022-09-17T10:27:59.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.102+0000 7fb4c25e7700 1 -- 172.21.15.62:0/2438850833 shutdown_connections 2022-09-17T10:27:59.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.102+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/2438850833 >> v2:172.21.15.159:3300/0 conn(0x7fb4bc17f910 0x7fb4bc17fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.102+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/2438850833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc0ec290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.102+0000 7fb4c25e7700 1 -- 172.21.15.62:0/2438850833 >> 172.21.15.62:0/2438850833 conn(0x7fb4bc0e2820 msgr2=0x7fb4bc0f0300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:59.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.102+0000 7fb4c25e7700 1 -- 172.21.15.62:0/2438850833 shutdown_connections 2022-09-17T10:27:59.110 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.102+0000 7fb4c25e7700 1 -- 172.21.15.62:0/2438850833 wait complete. 2022-09-17T10:27:59.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.103+0000 7fb4c25e7700 1 Processor -- start 2022-09-17T10:27:59.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.103+0000 7fb4c25e7700 1 -- start start 2022-09-17T10:27:59.118 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c25e7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc192df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:59.118 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c25e7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc174e80 0x7fb4bc0bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:59.119 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c25e7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4bc17f910 0x7fb4bc0bc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:59.119 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c25e7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc17dfc0 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.119 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c25e7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0ba700 con 0x7fb4bc174e80 2022-09-17T10:27:59.119 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c25e7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc1932e0 con 0x7fb4bc17f910 2022-09-17T10:27:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc192df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc192df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42804/0 (socket says 172.21.15.62:42804) 2022-09-17T10:27:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 -- 172.21.15.62:0/355092691 learned_addr learned my addr 172.21.15.62:0/355092691 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:27:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c0de4700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc174e80 0x7fb4bc0bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c1de6700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4bc17f910 0x7fb4bc0bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:59.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 -- 172.21.15.62:0/355092691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4bc17f910 msgr2=0x7fb4bc0bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:59.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4bc17f910 0x7fb4bc0bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 -- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc174e80 msgr2=0x7fb4bc0bbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:59.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc174e80 0x7fb4bc0bbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 -- 172.21.15.62:0/355092691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0009370 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c1de6700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4bc17f910 0x7fb4bc0bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:59.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c0de4700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc174e80 0x7fb4bc0bbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:27:59.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c15e5700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc192df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb4b400c840 tx=0x7fb4b4001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:59.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4b97fa700 1 -- 172.21.15.62:0/355092691 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4005c70 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4b97fa700 1 -- 172.21.15.62:0/355092691 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b4005df0 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc17d720 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4b97fa700 1 -- 172.21.15.62:0/355092691 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4007360 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.105+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc17dce0 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.106+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc0ba9e0 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.107+0000 7fb4b97fa700 1 -- 172.21.15.62:0/355092691 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb4b4010030 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.108+0000 7fb4b97fa700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb49c08ba10 0x7fb49c08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:27:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.108+0000 7fb4b97fa700 1 -- 172.21.15.62:0/355092691 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb4b40b0700 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.108+0000 7fb4c0de4700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb49c08ba10 0x7fb49c08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:27:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.108+0000 7fb4c0de4700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb49c08ba10 0x7fb49c08ded0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb4b0006dd0 tx=0x7fb4b0017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:27:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.112+0000 7fb4b97fa700 1 -- 172.21.15.62:0/355092691 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fb4b40813c0 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.328 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.327+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fb4bc0601c0 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.967+0000 7fb4b97fa700 1 -- 172.21.15.62:0/355092691 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb4b40015c0 con 0x7fb4bc0ebe30 2022-09-17T10:27:59.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.969+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb49c08ba10 msgr2=0x7fb49c08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:59.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.969+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb49c08ba10 0x7fb49c08ded0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb4b0006dd0 tx=0x7fb4b0017000).stop 2022-09-17T10:27:59.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.969+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4bc0ebe30 msgr2=0x7fb4bc192df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:27:59.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.969+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc192df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb4b400c840 tx=0x7fb4b4001530).stop 2022-09-17T10:27:59.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.970+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 shutdown_connections 2022-09-17T10:27:59.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.970+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb49c08ba10 0x7fb49c08ded0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.970+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4bc17f910 0x7fb4bc0bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.970+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4bc0ebe30 0x7fb4bc192df0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.970+0000 7fb4c25e7700 1 --2- 172.21.15.62:0/355092691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4bc174e80 0x7fb4bc0bbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:27:59.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.970+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 >> 172.21.15.62:0/355092691 conn(0x7fb4bc0e2820 msgr2=0x7fb4bc0e8960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:27:59.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.970+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 shutdown_connections 2022-09-17T10:27:59.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:27:59.970+0000 7fb4c25e7700 1 -- 172.21.15.62:0/355092691 wait complete. 2022-09-17T10:27:59.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-17T10:28:00.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.112+0000 7f56aa8f5700 1 Processor -- start 2022-09-17T10:28:00.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.112+0000 7f56aa8f5700 1 -- start start 2022-09-17T10:28:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56aa8f5700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f56a4174ea0 0x7f56a40e8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56aa8f5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56a4178840 0x7f56a417a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56aa8f5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a4179f40 con 0x7f56a4174ac0 2022-09-17T10:28:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56aa8f5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a40e8af0 con 0x7f56a4178840 2022-09-17T10:28:00.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56aa8f5700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a4179050 con 0x7f56a4174ea0 2022-09-17T10:28:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f56a4174ac0 0x7f56a40ec5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53090/0 (socket says 172.21.15.62:53090) 2022-09-17T10:28:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a3fff700 1 -- 172.21.15.62:0/1740604203 learned_addr learned my addr 172.21.15.62:0/1740604203 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a8e92700 1 --2- 172.21.15.62:0/1740604203 >> v2:172.21.15.62:3300/0 conn(0x7f56a4178840 0x7f56a417a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a37fe700 1 --2- 172.21.15.62:0/1740604203 >> v2:172.21.15.159:3300/0 conn(0x7f56a4174ea0 0x7f56a40e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a2ffd700 1 -- 172.21.15.62:0/1740604203 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555589491 0 0) 0x7f56a4179f40 con 0x7f56a4174ac0 2022-09-17T10:28:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a2ffd700 1 -- 172.21.15.62:0/1740604203 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56900033f0 con 0x7f56a4174ac0 2022-09-17T10:28:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a8e92700 1 -- 172.21.15.62:0/1740604203 >> v2:172.21.15.159:3300/0 conn(0x7f56a4174ea0 msgr2=0x7f56a40e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:00.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a8e92700 1 --2- 172.21.15.62:0/1740604203 >> v2:172.21.15.159:3300/0 conn(0x7f56a4174ea0 0x7f56a40e8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a8e92700 1 -- 172.21.15.62:0/1740604203 >> v1:172.21.15.62:6789/0 conn(0x7f56a4174ac0 legacy=0x7f56a40ec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a8e92700 1 -- 172.21.15.62:0/1740604203 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a4179330 con 0x7f56a4178840 2022-09-17T10:28:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a8e92700 1 --2- 172.21.15.62:0/1740604203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4178840 0x7f56a417a3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f56a4085590 tx=0x7f569c009780).ready entity=mon.0 client_cookie=52c98a3d9000c9cb server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a2ffd700 1 -- 172.21.15.62:0/1740604203 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00e070 con 0x7f56a4178840 2022-09-17T10:28:00.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a2ffd700 1 -- 172.21.15.62:0/1740604203 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c00bab0 con 0x7f56a4178840 2022-09-17T10:28:00.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.114+0000 7f56a2ffd700 1 -- 172.21.15.62:0/1740604203 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00be30 con 0x7f56a4178840 2022-09-17T10:28:00.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.115+0000 7f56aa8f5700 1 -- 172.21.15.62:0/1740604203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4178840 msgr2=0x7f56a417a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.115+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/1740604203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4178840 0x7f56a417a3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f56a4085590 tx=0x7f569c009780).stop 2022-09-17T10:28:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.115+0000 7f56aa8f5700 1 -- 172.21.15.62:0/1740604203 shutdown_connections 2022-09-17T10:28:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.115+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/1740604203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4178840 0x7f56a417a3d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.115+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/1740604203 >> v2:172.21.15.159:3300/0 conn(0x7f56a4174ea0 0x7f56a40e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.115+0000 7f56aa8f5700 1 -- 172.21.15.62:0/1740604203 >> 172.21.15.62:0/1740604203 conn(0x7f56a40f1c10 msgr2=0x7f56a40edbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.115+0000 7f56aa8f5700 1 -- 172.21.15.62:0/1740604203 shutdown_connections 2022-09-17T10:28:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.115+0000 7f56aa8f5700 1 -- 172.21.15.62:0/1740604203 wait complete. 2022-09-17T10:28:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.116+0000 7f56aa8f5700 1 Processor -- start 2022-09-17T10:28:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.117+0000 7f56aa8f5700 1 -- start start 2022-09-17T10:28:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56aa8f5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56a4174ac0 0x7f56a41695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56aa8f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4174ea0 0x7f56a4169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56aa8f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56a4178840 0x7f56a4063a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56aa8f5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a4067000 con 0x7f56a4174ea0 2022-09-17T10:28:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56aa8f5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40669f0 con 0x7f56a4174ac0 2022-09-17T10:28:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56aa8f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a4064800 con 0x7f56a4178840 2022-09-17T10:28:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4174ea0 0x7f56a4169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4174ea0 0x7f56a4169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42822/0 (socket says 172.21.15.62:42822) 2022-09-17T10:28:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 -- 172.21.15.62:0/666118252 learned_addr learned my addr 172.21.15.62:0/666118252 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a3fff700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56a4174ac0 0x7f56a41695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a8e92700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56a4178840 0x7f56a4063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 -- 172.21.15.62:0/666118252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56a4178840 msgr2=0x7f56a4063a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56a4178840 0x7f56a4063a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 -- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56a4174ac0 msgr2=0x7f56a41695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56a4174ac0 0x7f56a41695f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 -- 172.21.15.62:0/666118252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c009a20 con 0x7f56a4174ea0 2022-09-17T10:28:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56a37fe700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4174ea0 0x7f56a4169ae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f5698010b60 tx=0x7f5698009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f568bfff700 1 -- 172.21.15.62:0/666118252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800eb60 con 0x7f56a4174ea0 2022-09-17T10:28:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f568bfff700 1 -- 172.21.15.62:0/666118252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800ecc0 con 0x7f56a4174ea0 2022-09-17T10:28:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a4064ae0 con 0x7f56a4174ea0 2022-09-17T10:28:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f568bfff700 1 -- 172.21.15.62:0/666118252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569801a470 con 0x7f56a4174ea0 2022-09-17T10:28:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.118+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a4064dc0 con 0x7f56a4174ea0 2022-09-17T10:28:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.119+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a40671b0 con 0x7f56a4174ea0 2022-09-17T10:28:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.120+0000 7f568bfff700 1 -- 172.21.15.62:0/666118252 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f569801a820 con 0x7f56a4174ea0 2022-09-17T10:28:00.154 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.121+0000 7f568bfff700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f568408ba40 0x7f568408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.154 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.121+0000 7f568bfff700 1 -- 172.21.15.62:0/666118252 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f56980b3090 con 0x7f56a4174ea0 2022-09-17T10:28:00.154 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.121+0000 7f56a3fff700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f568408ba40 0x7f568408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.121+0000 7f56a3fff700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f568408ba40 0x7f568408df00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5694005750 tx=0x7f5694009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.125+0000 7f568bfff700 1 -- 172.21.15.62:0/666118252 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f56a40671b0 con 0x7f56a4174ea0 2022-09-17T10:28:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.337+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56a4178640 con 0x7f56a4174ea0 2022-09-17T10:28:00.340 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.338+0000 7f568bfff700 1 -- 172.21.15.62:0/666118252 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+10539 (secure 0 0 0) 0x7f5698083d50 con 0x7f56a4174ea0 2022-09-17T10:28:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/2161434381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2161434381},{"type":"v1","addr":"172.21.15.62:6833","nonce":2161434381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/1194163827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1194163827},{"type":"v1","addr":"172.21.15.62:6839","nonce":1194163827}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/413826247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":413826247},{"type":"v1","addr":"172.21.15.93:6835","nonce":413826247}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4325,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3152394380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3152394380},{"type":"v1","addr":"172.21.15.159:6836","nonce":3152394380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2292269070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2292269070},{"type":"v1","addr":"172.21.15.62:6835","nonce":2292269070}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4327,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/301789402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":301789402},{"type":"v1","addr":"172.21.15.93:6837","nonce":301789402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4329,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1156565194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1156565194},{"type":"v1","addr":"172.21.15.62:6837","nonce":1156565194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4333,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6839/135709201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":135709201},{"type":"v1","addr":"172.21.15.93:6839","nonce":135709201}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4336,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6841/1241271614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6840","nonce":1241271614},{"type":"v1","addr":"172.21.15.93:6841","nonce":1241271614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/426632534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":426632534},{"type":"v1","addr":"172.21.15.159:6833","nonce":426632534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-09-17T10:27:42.793084+0000","modified":"2022-09-17T10:27:59.962997+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4360":{"gid":4360,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/574611303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":574611303},{"type":"v1","addr":"172.21.15.159:6839","nonce":574611303}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4365":{"gid":4365,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/802951039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":802951039},{"type":"v1","addr":"172.21.15.159:6837","nonce":802951039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-09-17T10:28:00.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f568408ba40 msgr2=0x7f568408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f568408ba40 0x7f568408df00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5694005750 tx=0x7f5694009040).stop 2022-09-17T10:28:00.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4174ea0 msgr2=0x7f56a4169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4174ea0 0x7f56a4169ae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f5698010b60 tx=0x7f5698009060).stop 2022-09-17T10:28:00.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 shutdown_connections 2022-09-17T10:28:00.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f568408ba40 0x7f568408df00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56a4174ac0 0x7f56a41695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56a4178840 0x7f56a4063a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 --2- 172.21.15.62:0/666118252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56a4174ea0 0x7f56a4169ae0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 >> 172.21.15.62:0/666118252 conn(0x7f56a40f1c10 msgr2=0x7f56a4069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:00.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 shutdown_connections 2022-09-17T10:28:00.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.340+0000 7f56aa8f5700 1 -- 172.21.15.62:0/666118252 wait complete. 2022-09-17T10:28:00.348 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 11 2022-09-17T10:28:00.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:28:00.473 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.470+0000 7fe41fbb9700 1 Processor -- start 2022-09-17T10:28:00.473 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.471+0000 7fe41fbb9700 1 -- start start 2022-09-17T10:28:00.482 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41fbb9700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe418062950 0x7fe418062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.483 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41fbb9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4180c6dd0 con 0x7fe418175590 2022-09-17T10:28:00.483 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41fbb9700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4180642c0 con 0x7fe4181751b0 2022-09-17T10:28:00.483 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41fbb9700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4180f10e0 con 0x7fe418062950 2022-09-17T10:28:00.483 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41d154700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe418175590 0x7fe418180d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53100/0 (socket says 172.21.15.62:53100) 2022-09-17T10:28:00.484 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41d154700 1 -- 172.21.15.62:0/1916280682 learned_addr learned my addr 172.21.15.62:0/1916280682 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:00.484 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41e156700 1 --2- 172.21.15.62:0/1916280682 >> v2:172.21.15.159:3300/0 conn(0x7fe418062950 0x7fe418062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.484 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41c953700 1 -- 172.21.15.62:0/1916280682 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205041135 0 0) 0x7fe4180c6dd0 con 0x7fe418175590 2022-09-17T10:28:00.484 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41c953700 1 -- 172.21.15.62:0/1916280682 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4040033f0 con 0x7fe418175590 2022-09-17T10:28:00.485 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41c953700 1 -- 172.21.15.62:0/1916280682 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638450160 0 0) 0x7fe4040033f0 con 0x7fe418175590 2022-09-17T10:28:00.485 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41e156700 1 -- 172.21.15.62:0/1916280682 >> v1:172.21.15.93:6789/0 conn(0x7fe4181751b0 legacy=0x7fe418180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.485 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41e156700 1 -- 172.21.15.62:0/1916280682 >> v1:172.21.15.62:6789/0 conn(0x7fe418175590 legacy=0x7fe418180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.486 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.472+0000 7fe41e156700 1 -- 172.21.15.62:0/1916280682 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4181801e0 con 0x7fe418062950 2022-09-17T10:28:00.486 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41e156700 1 --2- 172.21.15.62:0/1916280682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 0x7fe418062dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe408009e60 tx=0x7fe408009780).ready entity=mon.2 client_cookie=e821bfa0ded44623 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.486 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41c953700 1 -- 172.21.15.62:0/1916280682 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800e070 con 0x7fe418062950 2022-09-17T10:28:00.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41c953700 1 -- 172.21.15.62:0/1916280682 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800b850 con 0x7fe418062950 2022-09-17T10:28:00.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41c953700 1 -- 172.21.15.62:0/1916280682 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c001470 con 0x7fe418062950 2022-09-17T10:28:00.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1916280682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 msgr2=0x7fe418062dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41fbb9700 1 --2- 172.21.15.62:0/1916280682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 0x7fe418062dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe408009e60 tx=0x7fe408009780).stop 2022-09-17T10:28:00.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1916280682 shutdown_connections 2022-09-17T10:28:00.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41fbb9700 1 --2- 172.21.15.62:0/1916280682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 0x7fe418062dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1916280682 >> 172.21.15.62:0/1916280682 conn(0x7fe41806a170 msgr2=0x7fe4180f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:00.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1916280682 shutdown_connections 2022-09-17T10:28:00.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.473+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1916280682 wait complete. 2022-09-17T10:28:00.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.475+0000 7fe41fbb9700 1 Processor -- start 2022-09-17T10:28:00.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.475+0000 7fe41fbb9700 1 -- start start 2022-09-17T10:28:00.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41fbb9700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 0x7fe41816bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41fbb9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4181751b0 0x7fe41817c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41fbb9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe418175590 0x7fe41817c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41fbb9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180f0660 con 0x7fe418175590 2022-09-17T10:28:00.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41fbb9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41817ce10 con 0x7fe4181751b0 2022-09-17T10:28:00.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41fbb9700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418085c30 con 0x7fe418062950 2022-09-17T10:28:00.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe418175590 0x7fe41817c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe418175590 0x7fe41817c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42838/0 (socket says 172.21.15.62:42838) 2022-09-17T10:28:00.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 -- 172.21.15.62:0/1727968811 learned_addr learned my addr 172.21.15.62:0/1727968811 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:00.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41d154700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4181751b0 0x7fe41817c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41d955700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 0x7fe41816bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 -- 172.21.15.62:0/1727968811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 msgr2=0x7fe41816bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 0x7fe41816bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.494 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 -- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4181751b0 msgr2=0x7fe41817c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.494 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4181751b0 0x7fe41817c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.495 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 -- 172.21.15.62:0/1727968811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408009a20 con 0x7fe418175590 2022-09-17T10:28:00.495 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41d955700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 0x7fe41816bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:00.496 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41e156700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe418175590 0x7fe41817c920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe408012bc0 tx=0x7fe418180150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.496 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe415ffb700 1 -- 172.21.15.62:0/1727968811 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080070e0 con 0x7fe418175590 2022-09-17T10:28:00.497 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41817d8f0 con 0x7fe418175590 2022-09-17T10:28:00.497 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe415ffb700 1 -- 172.21.15.62:0/1727968811 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408012e90 con 0x7fe418175590 2022-09-17T10:28:00.498 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.476+0000 7fe415ffb700 1 -- 172.21.15.62:0/1727968811 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40801e690 con 0x7fe418175590 2022-09-17T10:28:00.498 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.477+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41817d330 con 0x7fe418175590 2022-09-17T10:28:00.499 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.477+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe418085da0 con 0x7fe418175590 2022-09-17T10:28:00.499 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.478+0000 7fe415ffb700 1 -- 172.21.15.62:0/1727968811 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe408018070 con 0x7fe418175590 2022-09-17T10:28:00.499 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.479+0000 7fe415ffb700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe3f808ba40 0x7fe3f808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.501 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.479+0000 7fe415ffb700 1 -- 172.21.15.62:0/1727968811 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fe4080b24c0 con 0x7fe418175590 2022-09-17T10:28:00.501 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.479+0000 7fe41d955700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe3f808ba40 0x7fe3f808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.502 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.480+0000 7fe41d955700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe3f808ba40 0x7fe3f808df00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe410001730 tx=0x7fe410009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.502 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.482+0000 7fe415ffb700 1 -- 172.21.15.62:0/1727968811 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fe408083180 con 0x7fe418175590 2022-09-17T10:28:00.657 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.655+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4180f0840 con 0x7fe418175590 2022-09-17T10:28:00.659 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.656+0000 7fe415ffb700 1 -- 172.21.15.62:0/1727968811 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7fe408023070 con 0x7fe418175590 2022-09-17T10:28:00.660 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:00.661 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:28:00.664 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe3f808ba40 msgr2=0x7fe3f808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.664 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe3f808ba40 0x7fe3f808df00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe410001730 tx=0x7fe410009040).stop 2022-09-17T10:28:00.665 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe418175590 msgr2=0x7fe41817c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.665 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe418175590 0x7fe41817c920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe408012bc0 tx=0x7fe418180150).stop 2022-09-17T10:28:00.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 shutdown_connections 2022-09-17T10:28:00.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe3f808ba40 0x7fe3f808df00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe418175590 0x7fe41817c920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418062950 0x7fe41816bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 --2- 172.21.15.62:0/1727968811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4181751b0 0x7fe41817c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 >> 172.21.15.62:0/1727968811 conn(0x7fe41806a170 msgr2=0x7fe4180835c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:00.669 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 shutdown_connections 2022-09-17T10:28:00.669 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.658+0000 7fe41fbb9700 1 -- 172.21.15.62:0/1727968811 wait complete. 2022-09-17T10:28:00.673 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-09-17T10:28:00.674 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-09-17T10:28:00.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.789+0000 7f004a2f6700 1 Processor -- start 2022-09-17T10:28:00.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.789+0000 7f004a2f6700 1 -- start start 2022-09-17T10:28:00.817 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.790+0000 7f004a2f6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440c6dd0 con 0x7f0044175590 2022-09-17T10:28:00.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.790+0000 7f004a2f6700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00441801e0 con 0x7f0044062950 2022-09-17T10:28:00.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.790+0000 7f004a2f6700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440f0840 con 0x7f00441751b0 2022-09-17T10:28:00.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.790+0000 7f00437fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0044175590 0x7f0044180d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53114/0 (socket says 172.21.15.62:53114) 2022-09-17T10:28:00.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.790+0000 7f00437fe700 1 -- 172.21.15.62:0/4234690883 learned_addr learned my addr 172.21.15.62:0/4234690883 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:00.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.790+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001416438 0 0) 0x7f00440c6dd0 con 0x7f0044175590 2022-09-17T10:28:00.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.790+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00300033f0 con 0x7f0044175590 2022-09-17T10:28:00.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.790+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982629792 0 0) 0x7f00441801e0 con 0x7f0044062950 2022-09-17T10:28:00.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00440c6dd0 con 0x7f0044062950 2022-09-17T10:28:00.822 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 520116118 0 0) 0x7f00300033f0 con 0x7f0044175590 2022-09-17T10:28:00.822 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 >> v1:172.21.15.159:6789/0 conn(0x7f00441751b0 legacy=0x7f0044180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.823 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 >> v1:172.21.15.93:6789/0 conn(0x7f0044062950 legacy=0x7f0044062dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.823 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440f0b20 con 0x7f0044175590 2022-09-17T10:28:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f0034001470 con 0x7f0044175590 2022-09-17T10:28:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 >> v1:172.21.15.62:6789/0 conn(0x7f0044175590 legacy=0x7f0044180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0030003b40 0x7f0030003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0030004690 0x7f0030004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f003000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003000c1e0 con 0x7f0030005280 2022-09-17T10:28:00.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003000c350 con 0x7f0030004690 2022-09-17T10:28:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003000c510 con 0x7f0030003b40 2022-09-17T10:28:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0048893700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f003000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f00437fe700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0030004690 0x7f0030004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0043fff700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0030003b40 0x7f0030003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0048893700 1 -- 172.21.15.62:0/4234690883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0030003b40 msgr2=0x7f0030003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0048893700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0030003b40 0x7f0030003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0048893700 1 -- 172.21.15.62:0/4234690883 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0030004690 msgr2=0x7f0030004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0048893700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0030004690 0x7f0030004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0048893700 1 -- 172.21.15.62:0/4234690883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300033f0 con 0x7f0030005280 2022-09-17T10:28:00.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0048893700 1 -- 172.21.15.62:0/4234690883 reap_dead start 2022-09-17T10:28:00.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0048893700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f003000b980 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f003c001f50 tx=0x7f003c007f10).ready entity=mon.0 client_cookie=4ef7b42714cb5fdf server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c001860 con 0x7f0030005280 2022-09-17T10:28:00.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c00c700 con 0x7f0030005280 2022-09-17T10:28:00.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.791+0000 7f0042ffd700 1 -- 172.21.15.62:0/4234690883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c00caa0 con 0x7f0030005280 2022-09-17T10:28:00.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.792+0000 7f004a2f6700 1 -- 172.21.15.62:0/4234690883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 msgr2=0x7f003000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.792+0000 7f004a2f6700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f003000b980 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f003c001f50 tx=0x7f003c007f10).stop 2022-09-17T10:28:00.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.792+0000 7f004a2f6700 1 -- 172.21.15.62:0/4234690883 shutdown_connections 2022-09-17T10:28:00.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.792+0000 7f004a2f6700 1 --2- 172.21.15.62:0/4234690883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f003000b980 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.792+0000 7f004a2f6700 1 -- 172.21.15.62:0/4234690883 >> 172.21.15.62:0/4234690883 conn(0x7f004406a170 msgr2=0x7f00440f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:00.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.792+0000 7f004a2f6700 1 -- 172.21.15.62:0/4234690883 shutdown_connections 2022-09-17T10:28:00.832 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.792+0000 7f004a2f6700 1 -- 172.21.15.62:0/4234690883 wait complete. 2022-09-17T10:28:00.832 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.793+0000 7f004a2f6700 1 Processor -- start 2022-09-17T10:28:00.833 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.793+0000 7f004a2f6700 1 -- start start 2022-09-17T10:28:00.833 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.794+0000 7f004a2f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f004416efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.833 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.794+0000 7f004a2f6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00441798b0 0x7f0044179d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.834 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.794+0000 7f004a2f6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f004417a220 0x7f0044191e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.834 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.794+0000 7f004a2f6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044179420 con 0x7f0030005280 2022-09-17T10:28:00.835 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f004a2f6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440eddc0 con 0x7f00441798b0 2022-09-17T10:28:00.835 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f004a2f6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440ee0a0 con 0x7f004417a220 2022-09-17T10:28:00.835 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f004416efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.836 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f004416efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42852/0 (socket says 172.21.15.62:42852) 2022-09-17T10:28:00.836 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 -- 172.21.15.62:0/3675428840 learned_addr learned my addr 172.21.15.62:0/3675428840 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:00.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0048893700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f004417a220 0x7f0044191e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f00437fe700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00441798b0 0x7f0044179d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 -- 172.21.15.62:0/3675428840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f004417a220 msgr2=0x7f0044191e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f004417a220 0x7f0044191e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.838 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 -- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00441798b0 msgr2=0x7f0044179d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:00.838 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00441798b0 0x7f0044179d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:00.838 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 -- 172.21.15.62:0/3675428840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440ee380 con 0x7f0030005280 2022-09-17T10:28:00.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f0043fff700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f004416efb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f00380028c0 tx=0x7f0038007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f002bfff700 1 -- 172.21.15.62:0/3675428840 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038011590 con 0x7f0030005280 2022-09-17T10:28:00.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f002bfff700 1 -- 172.21.15.62:0/3675428840 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380116f0 con 0x7f0030005280 2022-09-17T10:28:00.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00441790b0 con 0x7f0030005280 2022-09-17T10:28:00.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f002bfff700 1 -- 172.21.15.62:0/3675428840 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038011a70 con 0x7f0030005280 2022-09-17T10:28:00.840 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.795+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0044192340 con 0x7f0030005280 2022-09-17T10:28:00.840 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.796+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0044179700 con 0x7f0030005280 2022-09-17T10:28:00.840 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.797+0000 7f002bfff700 1 -- 172.21.15.62:0/3675428840 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f003801a030 con 0x7f0030005280 2022-09-17T10:28:00.840 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.798+0000 7f002bfff700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f002408ba40 0x7f002408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:00.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.798+0000 7f002bfff700 1 -- 172.21.15.62:0/3675428840 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f00380b0a30 con 0x7f0030005280 2022-09-17T10:28:00.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.798+0000 7f00437fe700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f002408ba40 0x7f002408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:00.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.798+0000 7f00437fe700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f002408ba40 0x7f002408df00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0034001200 tx=0x7f0034009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:00.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.801+0000 7f002bfff700 1 -- 172.21.15.62:0/3675428840 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f0038081670 con 0x7f0030005280 2022-09-17T10:28:00.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.968+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 --> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0044179560 con 0x7f002408ba40 2022-09-17T10:28:00.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.982+0000 7f002bfff700 1 -- 172.21.15.62:0/3675428840 <== mgr.4114 v2:172.21.15.93:6832/81423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434602 (secure 0 0 0) 0x7f0034001080 con 0x7f002408ba40 2022-09-17T10:28:00.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:01.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f002408ba40 msgr2=0x7f002408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f002408ba40 0x7f002408df00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0034001200 tx=0x7f0034009040).stop 2022-09-17T10:28:01.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 msgr2=0x7f004416efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f004416efb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f00380028c0 tx=0x7f0038007bb0).stop 2022-09-17T10:28:01.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 shutdown_connections 2022-09-17T10:28:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f002408ba40 0x7f002408df00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f004417a220 0x7f0044191e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0030005280 0x7f004416efb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 --2- 172.21.15.62:0/3675428840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00441798b0 0x7f0044179d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 >> 172.21.15.62:0/3675428840 conn(0x7f004406a170 msgr2=0x7f0044170010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 shutdown_connections 2022-09-17T10:28:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:00.986+0000 7f004a2f6700 1 -- 172.21.15.62:0/3675428840 wait complete. 2022-09-17T10:28:01.005 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2022-09-17T10:28:01.007 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2022-09-17T10:28:00.881064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":63968,"kb_used_data":3904,"kb_used_omap":0,"kb_used_meta":59968,"kb_avail":1132398112,"statfs":{"total":1159641169920,"available":1159575666688,"internally_reserved":0,"allocated":3997696,"data_stored":1942926,"data_compressed":133308,"data_compressed_allocated":196608,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":61407232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003760"},"pg_stats":[{"pgid":"3.3f","version":"26'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822243+0000","last_change":"2022-09-17T10:27:42.422299+0000","last_active":"2022-09-17T10:27:46.822243+0000","last_peered":"2022-09-17T10:27:46.822243+0000","last_clean":"2022-09-17T10:27:46.822243+0000","last_became_active":"2022-09-17T10:27:42.421964+0000","last_became_peered":"2022-09-17T10:27:42.421964+0000","last_unstale":"2022-09-17T10:27:46.822243+0000","last_undegraded":"2022-09-17T10:27:46.822243+0000","last_fullsized":"2022-09-17T10:27:46.822243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826597+0000","last_change":"2022-09-17T10:27:42.817398+0000","last_active":"2022-09-17T10:27:46.826597+0000","last_peered":"2022-09-17T10:27:46.826597+0000","last_clean":"2022-09-17T10:27:46.826597+0000","last_became_active":"2022-09-17T10:27:42.816997+0000","last_became_peered":"2022-09-17T10:27:42.816997+0000","last_unstale":"2022-09-17T10:27:46.826597+0000","last_undegraded":"2022-09-17T10:27:46.826597+0000","last_fullsized":"2022-09-17T10:27:46.826597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823263+0000","last_change":"2022-09-17T10:27:42.420800+0000","last_active":"2022-09-17T10:27:46.823263+0000","last_peered":"2022-09-17T10:27:46.823263+0000","last_clean":"2022-09-17T10:27:46.823263+0000","last_became_active":"2022-09-17T10:27:42.420493+0000","last_became_peered":"2022-09-17T10:27:42.420493+0000","last_unstale":"2022-09-17T10:27:46.823263+0000","last_undegraded":"2022-09-17T10:27:46.823263+0000","last_fullsized":"2022-09-17T10:27:46.823263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828146+0000","last_change":"2022-09-17T10:27:42.813032+0000","last_active":"2022-09-17T10:27:46.828146+0000","last_peered":"2022-09-17T10:27:46.828146+0000","last_clean":"2022-09-17T10:27:46.828146+0000","last_became_active":"2022-09-17T10:27:42.812613+0000","last_became_peered":"2022-09-17T10:27:42.812613+0000","last_unstale":"2022-09-17T10:27:46.828146+0000","last_undegraded":"2022-09-17T10:27:46.828146+0000","last_fullsized":"2022-09-17T10:27:46.828146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823043+0000","last_change":"2022-09-17T10:27:42.419699+0000","last_active":"2022-09-17T10:27:46.823043+0000","last_peered":"2022-09-17T10:27:46.823043+0000","last_clean":"2022-09-17T10:27:46.823043+0000","last_became_active":"2022-09-17T10:27:42.419381+0000","last_became_peered":"2022-09-17T10:27:42.419381+0000","last_unstale":"2022-09-17T10:27:46.823043+0000","last_undegraded":"2022-09-17T10:27:46.823043+0000","last_fullsized":"2022-09-17T10:27:46.823043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821000+0000","last_change":"2022-09-17T10:27:42.812216+0000","last_active":"2022-09-17T10:27:46.821000+0000","last_peered":"2022-09-17T10:27:46.821000+0000","last_clean":"2022-09-17T10:27:46.821000+0000","last_became_active":"2022-09-17T10:27:42.811495+0000","last_became_peered":"2022-09-17T10:27:42.811495+0000","last_unstale":"2022-09-17T10:27:46.821000+0000","last_undegraded":"2022-09-17T10:27:46.821000+0000","last_fullsized":"2022-09-17T10:27:46.821000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821860+0000","last_change":"2022-09-17T10:27:42.423214+0000","last_active":"2022-09-17T10:27:46.821860+0000","last_peered":"2022-09-17T10:27:46.821860+0000","last_clean":"2022-09-17T10:27:46.821860+0000","last_became_active":"2022-09-17T10:27:42.422645+0000","last_became_peered":"2022-09-17T10:27:42.422645+0000","last_unstale":"2022-09-17T10:27:46.821860+0000","last_undegraded":"2022-09-17T10:27:46.821860+0000","last_fullsized":"2022-09-17T10:27:46.821860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821942+0000","last_change":"2022-09-17T10:27:42.816222+0000","last_active":"2022-09-17T10:27:46.821942+0000","last_peered":"2022-09-17T10:27:46.821942+0000","last_clean":"2022-09-17T10:27:46.821942+0000","last_became_active":"2022-09-17T10:27:42.815835+0000","last_became_peered":"2022-09-17T10:27:42.815835+0000","last_unstale":"2022-09-17T10:27:46.821942+0000","last_undegraded":"2022-09-17T10:27:46.821942+0000","last_fullsized":"2022-09-17T10:27:46.821942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.833135+0000","last_change":"2022-09-17T10:27:42.422984+0000","last_active":"2022-09-17T10:27:46.833135+0000","last_peered":"2022-09-17T10:27:46.833135+0000","last_clean":"2022-09-17T10:27:46.833135+0000","last_became_active":"2022-09-17T10:27:42.422710+0000","last_became_peered":"2022-09-17T10:27:42.422710+0000","last_unstale":"2022-09-17T10:27:46.833135+0000","last_undegraded":"2022-09-17T10:27:46.833135+0000","last_fullsized":"2022-09-17T10:27:46.833135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828197+0000","last_change":"2022-09-17T10:27:42.812970+0000","last_active":"2022-09-17T10:27:46.828197+0000","last_peered":"2022-09-17T10:27:46.828197+0000","last_clean":"2022-09-17T10:27:46.828197+0000","last_became_active":"2022-09-17T10:27:42.812675+0000","last_became_peered":"2022-09-17T10:27:42.812675+0000","last_unstale":"2022-09-17T10:27:46.828197+0000","last_undegraded":"2022-09-17T10:27:46.828197+0000","last_fullsized":"2022-09-17T10:27:46.828197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824416+0000","last_change":"2022-09-17T10:27:42.417757+0000","last_active":"2022-09-17T10:27:46.824416+0000","last_peered":"2022-09-17T10:27:46.824416+0000","last_clean":"2022-09-17T10:27:46.824416+0000","last_became_active":"2022-09-17T10:27:42.417425+0000","last_became_peered":"2022-09-17T10:27:42.417425+0000","last_unstale":"2022-09-17T10:27:46.824416+0000","last_undegraded":"2022-09-17T10:27:46.824416+0000","last_fullsized":"2022-09-17T10:27:46.824416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821143+0000","last_change":"2022-09-17T10:27:42.815053+0000","last_active":"2022-09-17T10:27:46.821143+0000","last_peered":"2022-09-17T10:27:46.821143+0000","last_clean":"2022-09-17T10:27:46.821143+0000","last_became_active":"2022-09-17T10:27:42.814772+0000","last_became_peered":"2022-09-17T10:27:42.814772+0000","last_unstale":"2022-09-17T10:27:46.821143+0000","last_undegraded":"2022-09-17T10:27:46.821143+0000","last_fullsized":"2022-09-17T10:27:46.821143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831182+0000","last_change":"2022-09-17T10:27:42.420271+0000","last_active":"2022-09-17T10:27:46.831182+0000","last_peered":"2022-09-17T10:27:46.831182+0000","last_clean":"2022-09-17T10:27:46.831182+0000","last_became_active":"2022-09-17T10:27:42.419991+0000","last_became_peered":"2022-09-17T10:27:42.419991+0000","last_unstale":"2022-09-17T10:27:46.831182+0000","last_undegraded":"2022-09-17T10:27:46.831182+0000","last_fullsized":"2022-09-17T10:27:46.831182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823843+0000","last_change":"2022-09-17T10:27:42.806227+0000","last_active":"2022-09-17T10:27:46.823843+0000","last_peered":"2022-09-17T10:27:46.823843+0000","last_clean":"2022-09-17T10:27:46.823843+0000","last_became_active":"2022-09-17T10:27:42.805882+0000","last_became_peered":"2022-09-17T10:27:42.805882+0000","last_unstale":"2022-09-17T10:27:46.823843+0000","last_undegraded":"2022-09-17T10:27:46.823843+0000","last_fullsized":"2022-09-17T10:27:46.823843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830859+0000","last_change":"2022-09-17T10:27:42.423044+0000","last_active":"2022-09-17T10:27:46.830859+0000","last_peered":"2022-09-17T10:27:46.830859+0000","last_clean":"2022-09-17T10:27:46.830859+0000","last_became_active":"2022-09-17T10:27:42.421055+0000","last_became_peered":"2022-09-17T10:27:42.421055+0000","last_unstale":"2022-09-17T10:27:46.830859+0000","last_undegraded":"2022-09-17T10:27:46.830859+0000","last_fullsized":"2022-09-17T10:27:46.830859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823833+0000","last_change":"2022-09-17T10:27:42.807118+0000","last_active":"2022-09-17T10:27:46.823833+0000","last_peered":"2022-09-17T10:27:46.823833+0000","last_clean":"2022-09-17T10:27:46.823833+0000","last_became_active":"2022-09-17T10:27:42.806225+0000","last_became_peered":"2022-09-17T10:27:42.806225+0000","last_unstale":"2022-09-17T10:27:46.823833+0000","last_undegraded":"2022-09-17T10:27:46.823833+0000","last_fullsized":"2022-09-17T10:27:46.823833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828853+0000","last_change":"2022-09-17T10:27:42.412247+0000","last_active":"2022-09-17T10:27:46.828853+0000","last_peered":"2022-09-17T10:27:46.828853+0000","last_clean":"2022-09-17T10:27:46.828853+0000","last_became_active":"2022-09-17T10:27:42.411939+0000","last_became_peered":"2022-09-17T10:27:42.411939+0000","last_unstale":"2022-09-17T10:27:46.828853+0000","last_undegraded":"2022-09-17T10:27:46.828853+0000","last_fullsized":"2022-09-17T10:27:46.828853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821076+0000","last_change":"2022-09-17T10:27:42.813817+0000","last_active":"2022-09-17T10:27:46.821076+0000","last_peered":"2022-09-17T10:27:46.821076+0000","last_clean":"2022-09-17T10:27:46.821076+0000","last_became_active":"2022-09-17T10:27:42.811044+0000","last_became_peered":"2022-09-17T10:27:42.811044+0000","last_unstale":"2022-09-17T10:27:46.821076+0000","last_undegraded":"2022-09-17T10:27:46.821076+0000","last_fullsized":"2022-09-17T10:27:46.821076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824466+0000","last_change":"2022-09-17T10:27:42.424111+0000","last_active":"2022-09-17T10:27:46.824466+0000","last_peered":"2022-09-17T10:27:46.824466+0000","last_clean":"2022-09-17T10:27:46.824466+0000","last_became_active":"2022-09-17T10:27:42.423848+0000","last_became_peered":"2022-09-17T10:27:42.423848+0000","last_unstale":"2022-09-17T10:27:46.824466+0000","last_undegraded":"2022-09-17T10:27:46.824466+0000","last_fullsized":"2022-09-17T10:27:46.824466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826305+0000","last_change":"2022-09-17T10:27:42.812631+0000","last_active":"2022-09-17T10:27:46.826305+0000","last_peered":"2022-09-17T10:27:46.826305+0000","last_clean":"2022-09-17T10:27:46.826305+0000","last_became_active":"2022-09-17T10:27:42.812131+0000","last_became_peered":"2022-09-17T10:27:42.812131+0000","last_unstale":"2022-09-17T10:27:46.826305+0000","last_undegraded":"2022-09-17T10:27:46.826305+0000","last_fullsized":"2022-09-17T10:27:46.826305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828342+0000","last_change":"2022-09-17T10:27:42.423717+0000","last_active":"2022-09-17T10:27:46.828342+0000","last_peered":"2022-09-17T10:27:46.828342+0000","last_clean":"2022-09-17T10:27:46.828342+0000","last_became_active":"2022-09-17T10:27:42.423419+0000","last_became_peered":"2022-09-17T10:27:42.423419+0000","last_unstale":"2022-09-17T10:27:46.828342+0000","last_undegraded":"2022-09-17T10:27:46.828342+0000","last_fullsized":"2022-09-17T10:27:46.828342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826766+0000","last_change":"2022-09-17T10:27:42.815134+0000","last_active":"2022-09-17T10:27:46.826766+0000","last_peered":"2022-09-17T10:27:46.826766+0000","last_clean":"2022-09-17T10:27:46.826766+0000","last_became_active":"2022-09-17T10:27:42.814787+0000","last_became_peered":"2022-09-17T10:27:42.814787+0000","last_unstale":"2022-09-17T10:27:46.826766+0000","last_undegraded":"2022-09-17T10:27:46.826766+0000","last_fullsized":"2022-09-17T10:27:46.826766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'7","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:55.773333+0000","last_change":"2022-09-17T10:27:42.420222+0000","last_active":"2022-09-17T10:27:55.773333+0000","last_peered":"2022-09-17T10:27:55.773333+0000","last_clean":"2022-09-17T10:27:55.773333+0000","last_became_active":"2022-09-17T10:27:42.419931+0000","last_became_peered":"2022-09-17T10:27:42.419931+0000","last_unstale":"2022-09-17T10:27:55.773333+0000","last_undegraded":"2022-09-17T10:27:55.773333+0000","last_fullsized":"2022-09-17T10:27:55.773333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3071,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828436+0000","last_change":"2022-09-17T10:27:42.819910+0000","last_active":"2022-09-17T10:27:46.828436+0000","last_peered":"2022-09-17T10:27:46.828436+0000","last_clean":"2022-09-17T10:27:46.828436+0000","last_became_active":"2022-09-17T10:27:42.819746+0000","last_became_peered":"2022-09-17T10:27:42.819746+0000","last_unstale":"2022-09-17T10:27:46.828436+0000","last_undegraded":"2022-09-17T10:27:46.828436+0000","last_fullsized":"2022-09-17T10:27:46.828436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877176+0000","last_change":"2022-09-17T10:27:42.415809+0000","last_active":"2022-09-17T10:27:46.877176+0000","last_peered":"2022-09-17T10:27:46.877176+0000","last_clean":"2022-09-17T10:27:46.877176+0000","last_became_active":"2022-09-17T10:27:42.415484+0000","last_became_peered":"2022-09-17T10:27:42.415484+0000","last_unstale":"2022-09-17T10:27:46.877176+0000","last_undegraded":"2022-09-17T10:27:46.877176+0000","last_fullsized":"2022-09-17T10:27:46.877176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823651+0000","last_change":"2022-09-17T10:27:42.807756+0000","last_active":"2022-09-17T10:27:46.823651+0000","last_peered":"2022-09-17T10:27:46.823651+0000","last_clean":"2022-09-17T10:27:46.823651+0000","last_became_active":"2022-09-17T10:27:42.805782+0000","last_became_peered":"2022-09-17T10:27:42.805782+0000","last_unstale":"2022-09-17T10:27:46.823651+0000","last_undegraded":"2022-09-17T10:27:46.823651+0000","last_fullsized":"2022-09-17T10:27:46.823651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823055+0000","last_change":"2022-09-17T10:27:42.422195+0000","last_active":"2022-09-17T10:27:46.823055+0000","last_peered":"2022-09-17T10:27:46.823055+0000","last_clean":"2022-09-17T10:27:46.823055+0000","last_became_active":"2022-09-17T10:27:42.421922+0000","last_became_peered":"2022-09-17T10:27:42.421922+0000","last_unstale":"2022-09-17T10:27:46.823055+0000","last_undegraded":"2022-09-17T10:27:46.823055+0000","last_fullsized":"2022-09-17T10:27:46.823055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821862+0000","last_change":"2022-09-17T10:27:42.813050+0000","last_active":"2022-09-17T10:27:46.821862+0000","last_peered":"2022-09-17T10:27:46.821862+0000","last_clean":"2022-09-17T10:27:46.821862+0000","last_became_active":"2022-09-17T10:27:42.812770+0000","last_became_peered":"2022-09-17T10:27:42.812770+0000","last_unstale":"2022-09-17T10:27:46.821862+0000","last_undegraded":"2022-09-17T10:27:46.821862+0000","last_fullsized":"2022-09-17T10:27:46.821862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822857+0000","last_change":"2022-09-17T10:27:42.422344+0000","last_active":"2022-09-17T10:27:46.822857+0000","last_peered":"2022-09-17T10:27:46.822857+0000","last_clean":"2022-09-17T10:27:46.822857+0000","last_became_active":"2022-09-17T10:27:42.422015+0000","last_became_peered":"2022-09-17T10:27:42.422015+0000","last_unstale":"2022-09-17T10:27:46.822857+0000","last_undegraded":"2022-09-17T10:27:46.822857+0000","last_fullsized":"2022-09-17T10:27:46.822857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822890+0000","last_change":"2022-09-17T10:27:42.814260+0000","last_active":"2022-09-17T10:27:46.822890+0000","last_peered":"2022-09-17T10:27:46.822890+0000","last_clean":"2022-09-17T10:27:46.822890+0000","last_became_active":"2022-09-17T10:27:42.812936+0000","last_became_peered":"2022-09-17T10:27:42.812936+0000","last_unstale":"2022-09-17T10:27:46.822890+0000","last_undegraded":"2022-09-17T10:27:46.822890+0000","last_fullsized":"2022-09-17T10:27:46.822890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"26'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826690+0000","last_change":"2022-09-17T10:27:42.417825+0000","last_active":"2022-09-17T10:27:46.826690+0000","last_peered":"2022-09-17T10:27:46.826690+0000","last_clean":"2022-09-17T10:27:46.826690+0000","last_became_active":"2022-09-17T10:27:42.417512+0000","last_became_peered":"2022-09-17T10:27:42.417512+0000","last_unstale":"2022-09-17T10:27:46.826690+0000","last_undegraded":"2022-09-17T10:27:46.826690+0000","last_fullsized":"2022-09-17T10:27:46.826690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823543+0000","last_change":"2022-09-17T10:27:42.807539+0000","last_active":"2022-09-17T10:27:46.823543+0000","last_peered":"2022-09-17T10:27:46.823543+0000","last_clean":"2022-09-17T10:27:46.823543+0000","last_became_active":"2022-09-17T10:27:42.807279+0000","last_became_peered":"2022-09-17T10:27:42.807279+0000","last_unstale":"2022-09-17T10:27:46.823543+0000","last_undegraded":"2022-09-17T10:27:46.823543+0000","last_fullsized":"2022-09-17T10:27:46.823543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822418+0000","last_change":"2022-09-17T10:27:42.422307+0000","last_active":"2022-09-17T10:27:46.822418+0000","last_peered":"2022-09-17T10:27:46.822418+0000","last_clean":"2022-09-17T10:27:46.822418+0000","last_became_active":"2022-09-17T10:27:42.421975+0000","last_became_peered":"2022-09-17T10:27:42.421975+0000","last_unstale":"2022-09-17T10:27:46.822418+0000","last_undegraded":"2022-09-17T10:27:46.822418+0000","last_fullsized":"2022-09-17T10:27:46.822418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821707+0000","last_change":"2022-09-17T10:27:42.810271+0000","last_active":"2022-09-17T10:27:46.821707+0000","last_peered":"2022-09-17T10:27:46.821707+0000","last_clean":"2022-09-17T10:27:46.821707+0000","last_became_active":"2022-09-17T10:27:42.809991+0000","last_became_peered":"2022-09-17T10:27:42.809991+0000","last_unstale":"2022-09-17T10:27:46.821707+0000","last_undegraded":"2022-09-17T10:27:46.821707+0000","last_fullsized":"2022-09-17T10:27:46.821707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823546+0000","last_change":"2022-09-17T10:27:42.414343+0000","last_active":"2022-09-17T10:27:46.823546+0000","last_peered":"2022-09-17T10:27:46.823546+0000","last_clean":"2022-09-17T10:27:46.823546+0000","last_became_active":"2022-09-17T10:27:42.413935+0000","last_became_peered":"2022-09-17T10:27:42.413935+0000","last_unstale":"2022-09-17T10:27:46.823546+0000","last_undegraded":"2022-09-17T10:27:46.823546+0000","last_fullsized":"2022-09-17T10:27:46.823546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823831+0000","last_change":"2022-09-17T10:27:42.804945+0000","last_active":"2022-09-17T10:27:46.823831+0000","last_peered":"2022-09-17T10:27:46.823831+0000","last_clean":"2022-09-17T10:27:46.823831+0000","last_became_active":"2022-09-17T10:27:42.804661+0000","last_became_peered":"2022-09-17T10:27:42.804661+0000","last_unstale":"2022-09-17T10:27:46.823831+0000","last_undegraded":"2022-09-17T10:27:46.823831+0000","last_fullsized":"2022-09-17T10:27:46.823831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824216+0000","last_change":"2022-09-17T10:27:42.423897+0000","last_active":"2022-09-17T10:27:46.824216+0000","last_peered":"2022-09-17T10:27:46.824216+0000","last_clean":"2022-09-17T10:27:46.824216+0000","last_became_active":"2022-09-17T10:27:42.423587+0000","last_became_peered":"2022-09-17T10:27:42.423587+0000","last_unstale":"2022-09-17T10:27:46.824216+0000","last_undegraded":"2022-09-17T10:27:46.824216+0000","last_fullsized":"2022-09-17T10:27:46.824216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821855+0000","last_change":"2022-09-17T10:27:42.814043+0000","last_active":"2022-09-17T10:27:46.821855+0000","last_peered":"2022-09-17T10:27:46.821855+0000","last_clean":"2022-09-17T10:27:46.821855+0000","last_became_active":"2022-09-17T10:27:42.813400+0000","last_became_peered":"2022-09-17T10:27:42.813400+0000","last_unstale":"2022-09-17T10:27:46.821855+0000","last_undegraded":"2022-09-17T10:27:46.821855+0000","last_fullsized":"2022-09-17T10:27:46.821855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821847+0000","last_change":"2022-09-17T10:27:42.420351+0000","last_active":"2022-09-17T10:27:46.821847+0000","last_peered":"2022-09-17T10:27:46.821847+0000","last_clean":"2022-09-17T10:27:46.821847+0000","last_became_active":"2022-09-17T10:27:42.420099+0000","last_became_peered":"2022-09-17T10:27:42.420099+0000","last_unstale":"2022-09-17T10:27:46.821847+0000","last_undegraded":"2022-09-17T10:27:46.821847+0000","last_fullsized":"2022-09-17T10:27:46.821847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823380+0000","last_change":"2022-09-17T10:27:42.809309+0000","last_active":"2022-09-17T10:27:46.823380+0000","last_peered":"2022-09-17T10:27:46.823380+0000","last_clean":"2022-09-17T10:27:46.823380+0000","last_became_active":"2022-09-17T10:27:42.809010+0000","last_became_peered":"2022-09-17T10:27:42.809010+0000","last_unstale":"2022-09-17T10:27:46.823380+0000","last_undegraded":"2022-09-17T10:27:46.823380+0000","last_fullsized":"2022-09-17T10:27:46.823380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877081+0000","last_change":"2022-09-17T10:27:42.420420+0000","last_active":"2022-09-17T10:27:46.877081+0000","last_peered":"2022-09-17T10:27:46.877081+0000","last_clean":"2022-09-17T10:27:46.877081+0000","last_became_active":"2022-09-17T10:27:42.420111+0000","last_became_peered":"2022-09-17T10:27:42.420111+0000","last_unstale":"2022-09-17T10:27:46.877081+0000","last_undegraded":"2022-09-17T10:27:46.877081+0000","last_fullsized":"2022-09-17T10:27:46.877081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828081+0000","last_change":"2022-09-17T10:27:42.813626+0000","last_active":"2022-09-17T10:27:46.828081+0000","last_peered":"2022-09-17T10:27:46.828081+0000","last_clean":"2022-09-17T10:27:46.828081+0000","last_became_active":"2022-09-17T10:27:42.813315+0000","last_became_peered":"2022-09-17T10:27:42.813315+0000","last_unstale":"2022-09-17T10:27:46.828081+0000","last_undegraded":"2022-09-17T10:27:46.828081+0000","last_fullsized":"2022-09-17T10:27:46.828081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828974+0000","last_change":"2022-09-17T10:27:42.418323+0000","last_active":"2022-09-17T10:27:46.828974+0000","last_peered":"2022-09-17T10:27:46.828974+0000","last_clean":"2022-09-17T10:27:46.828974+0000","last_became_active":"2022-09-17T10:27:42.417741+0000","last_became_peered":"2022-09-17T10:27:42.417741+0000","last_unstale":"2022-09-17T10:27:46.828974+0000","last_undegraded":"2022-09-17T10:27:46.828974+0000","last_fullsized":"2022-09-17T10:27:46.828974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877907+0000","last_change":"2022-09-17T10:27:42.815309+0000","last_active":"2022-09-17T10:27:46.877907+0000","last_peered":"2022-09-17T10:27:46.877907+0000","last_clean":"2022-09-17T10:27:46.877907+0000","last_became_active":"2022-09-17T10:27:42.815017+0000","last_became_peered":"2022-09-17T10:27:42.815017+0000","last_unstale":"2022-09-17T10:27:46.877907+0000","last_undegraded":"2022-09-17T10:27:46.877907+0000","last_fullsized":"2022-09-17T10:27:46.877907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831220+0000","last_change":"2022-09-17T10:27:42.426225+0000","last_active":"2022-09-17T10:27:46.831220+0000","last_peered":"2022-09-17T10:27:46.831220+0000","last_clean":"2022-09-17T10:27:46.831220+0000","last_became_active":"2022-09-17T10:27:42.425653+0000","last_became_peered":"2022-09-17T10:27:42.425653+0000","last_unstale":"2022-09-17T10:27:46.831220+0000","last_undegraded":"2022-09-17T10:27:46.831220+0000","last_fullsized":"2022-09-17T10:27:46.831220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823944+0000","last_change":"2022-09-17T10:27:42.811093+0000","last_active":"2022-09-17T10:27:46.823944+0000","last_peered":"2022-09-17T10:27:46.823944+0000","last_clean":"2022-09-17T10:27:46.823944+0000","last_became_active":"2022-09-17T10:27:42.810788+0000","last_became_peered":"2022-09-17T10:27:42.810788+0000","last_unstale":"2022-09-17T10:27:46.823944+0000","last_undegraded":"2022-09-17T10:27:46.823944+0000","last_fullsized":"2022-09-17T10:27:46.823944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826854+0000","last_change":"2022-09-17T10:27:42.418052+0000","last_active":"2022-09-17T10:27:46.826854+0000","last_peered":"2022-09-17T10:27:46.826854+0000","last_clean":"2022-09-17T10:27:46.826854+0000","last_became_active":"2022-09-17T10:27:42.417695+0000","last_became_peered":"2022-09-17T10:27:42.417695+0000","last_unstale":"2022-09-17T10:27:46.826854+0000","last_undegraded":"2022-09-17T10:27:46.826854+0000","last_fullsized":"2022-09-17T10:27:46.826854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823676+0000","last_change":"2022-09-17T10:27:42.816896+0000","last_active":"2022-09-17T10:27:46.823676+0000","last_peered":"2022-09-17T10:27:46.823676+0000","last_clean":"2022-09-17T10:27:46.823676+0000","last_became_active":"2022-09-17T10:27:42.816607+0000","last_became_peered":"2022-09-17T10:27:42.816607+0000","last_unstale":"2022-09-17T10:27:46.823676+0000","last_undegraded":"2022-09-17T10:27:46.823676+0000","last_fullsized":"2022-09-17T10:27:46.823676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831328+0000","last_change":"2022-09-17T10:27:42.421839+0000","last_active":"2022-09-17T10:27:46.831328+0000","last_peered":"2022-09-17T10:27:46.831328+0000","last_clean":"2022-09-17T10:27:46.831328+0000","last_became_active":"2022-09-17T10:27:42.421558+0000","last_became_peered":"2022-09-17T10:27:42.421558+0000","last_unstale":"2022-09-17T10:27:46.831328+0000","last_undegraded":"2022-09-17T10:27:46.831328+0000","last_fullsized":"2022-09-17T10:27:46.831328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822971+0000","last_change":"2022-09-17T10:27:42.812667+0000","last_active":"2022-09-17T10:27:46.822971+0000","last_peered":"2022-09-17T10:27:46.822971+0000","last_clean":"2022-09-17T10:27:46.822971+0000","last_became_active":"2022-09-17T10:27:42.812360+0000","last_became_peered":"2022-09-17T10:27:42.812360+0000","last_unstale":"2022-09-17T10:27:46.822971+0000","last_undegraded":"2022-09-17T10:27:46.822971+0000","last_fullsized":"2022-09-17T10:27:46.822971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.278681+0000","last_change":"2022-09-17T10:27:42.418422+0000","last_active":"2022-09-17T10:27:47.278681+0000","last_peered":"2022-09-17T10:27:47.278681+0000","last_clean":"2022-09-17T10:27:47.278681+0000","last_became_active":"2022-09-17T10:27:42.418158+0000","last_became_peered":"2022-09-17T10:27:42.418158+0000","last_unstale":"2022-09-17T10:27:47.278681+0000","last_undegraded":"2022-09-17T10:27:47.278681+0000","last_fullsized":"2022-09-17T10:27:47.278681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876897+0000","last_change":"2022-09-17T10:27:42.816353+0000","last_active":"2022-09-17T10:27:46.876897+0000","last_peered":"2022-09-17T10:27:46.876897+0000","last_clean":"2022-09-17T10:27:46.876897+0000","last_became_active":"2022-09-17T10:27:42.816143+0000","last_became_peered":"2022-09-17T10:27:42.816143+0000","last_unstale":"2022-09-17T10:27:46.876897+0000","last_undegraded":"2022-09-17T10:27:46.876897+0000","last_fullsized":"2022-09-17T10:27:46.876897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822690+0000","last_change":"2022-09-17T10:27:42.415503+0000","last_active":"2022-09-17T10:27:46.822690+0000","last_peered":"2022-09-17T10:27:46.822690+0000","last_clean":"2022-09-17T10:27:46.822690+0000","last_became_active":"2022-09-17T10:27:42.415203+0000","last_became_peered":"2022-09-17T10:27:42.415203+0000","last_unstale":"2022-09-17T10:27:46.822690+0000","last_undegraded":"2022-09-17T10:27:46.822690+0000","last_fullsized":"2022-09-17T10:27:46.822690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821740+0000","last_change":"2022-09-17T10:27:42.814233+0000","last_active":"2022-09-17T10:27:46.821740+0000","last_peered":"2022-09-17T10:27:46.821740+0000","last_clean":"2022-09-17T10:27:46.821740+0000","last_became_active":"2022-09-17T10:27:42.813735+0000","last_became_peered":"2022-09-17T10:27:42.813735+0000","last_unstale":"2022-09-17T10:27:46.821740+0000","last_undegraded":"2022-09-17T10:27:46.821740+0000","last_fullsized":"2022-09-17T10:27:46.821740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877411+0000","last_change":"2022-09-17T10:27:42.420755+0000","last_active":"2022-09-17T10:27:46.877411+0000","last_peered":"2022-09-17T10:27:46.877411+0000","last_clean":"2022-09-17T10:27:46.877411+0000","last_became_active":"2022-09-17T10:27:42.420413+0000","last_became_peered":"2022-09-17T10:27:42.420413+0000","last_unstale":"2022-09-17T10:27:46.877411+0000","last_undegraded":"2022-09-17T10:27:46.877411+0000","last_fullsized":"2022-09-17T10:27:46.877411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831001+0000","last_change":"2022-09-17T10:27:42.818083+0000","last_active":"2022-09-17T10:27:46.831001+0000","last_peered":"2022-09-17T10:27:46.831001+0000","last_clean":"2022-09-17T10:27:46.831001+0000","last_became_active":"2022-09-17T10:27:42.817877+0000","last_became_peered":"2022-09-17T10:27:42.817877+0000","last_unstale":"2022-09-17T10:27:46.831001+0000","last_undegraded":"2022-09-17T10:27:46.831001+0000","last_fullsized":"2022-09-17T10:27:46.831001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824985+0000","last_change":"2022-09-17T10:27:42.419616+0000","last_active":"2022-09-17T10:27:46.824985+0000","last_peered":"2022-09-17T10:27:46.824985+0000","last_clean":"2022-09-17T10:27:46.824985+0000","last_became_active":"2022-09-17T10:27:42.419310+0000","last_became_peered":"2022-09-17T10:27:42.419310+0000","last_unstale":"2022-09-17T10:27:46.824985+0000","last_undegraded":"2022-09-17T10:27:46.824985+0000","last_fullsized":"2022-09-17T10:27:46.824985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825681+0000","last_change":"2022-09-17T10:27:42.817667+0000","last_active":"2022-09-17T10:27:46.825681+0000","last_peered":"2022-09-17T10:27:46.825681+0000","last_clean":"2022-09-17T10:27:46.825681+0000","last_became_active":"2022-09-17T10:27:42.817320+0000","last_became_peered":"2022-09-17T10:27:42.817320+0000","last_unstale":"2022-09-17T10:27:46.825681+0000","last_undegraded":"2022-09-17T10:27:46.825681+0000","last_fullsized":"2022-09-17T10:27:46.825681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824135+0000","last_change":"2022-09-17T10:27:42.423348+0000","last_active":"2022-09-17T10:27:46.824135+0000","last_peered":"2022-09-17T10:27:46.824135+0000","last_clean":"2022-09-17T10:27:46.824135+0000","last_became_active":"2022-09-17T10:27:42.423040+0000","last_became_peered":"2022-09-17T10:27:42.423040+0000","last_unstale":"2022-09-17T10:27:46.824135+0000","last_undegraded":"2022-09-17T10:27:46.824135+0000","last_fullsized":"2022-09-17T10:27:46.824135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822997+0000","last_change":"2022-09-17T10:27:42.808072+0000","last_active":"2022-09-17T10:27:46.822997+0000","last_peered":"2022-09-17T10:27:46.822997+0000","last_clean":"2022-09-17T10:27:46.822997+0000","last_became_active":"2022-09-17T10:27:42.807765+0000","last_became_peered":"2022-09-17T10:27:42.807765+0000","last_unstale":"2022-09-17T10:27:46.822997+0000","last_undegraded":"2022-09-17T10:27:46.822997+0000","last_fullsized":"2022-09-17T10:27:46.822997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823608+0000","last_change":"2022-09-17T10:27:42.417146+0000","last_active":"2022-09-17T10:27:46.823608+0000","last_peered":"2022-09-17T10:27:46.823608+0000","last_clean":"2022-09-17T10:27:46.823608+0000","last_became_active":"2022-09-17T10:27:42.416444+0000","last_became_peered":"2022-09-17T10:27:42.416444+0000","last_unstale":"2022-09-17T10:27:46.823608+0000","last_undegraded":"2022-09-17T10:27:46.823608+0000","last_fullsized":"2022-09-17T10:27:46.823608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879652+0000","last_change":"2022-09-17T10:27:42.808199+0000","last_active":"2022-09-17T10:27:46.879652+0000","last_peered":"2022-09-17T10:27:46.879652+0000","last_clean":"2022-09-17T10:27:46.879652+0000","last_became_active":"2022-09-17T10:27:42.807904+0000","last_became_peered":"2022-09-17T10:27:42.807904+0000","last_unstale":"2022-09-17T10:27:46.879652+0000","last_undegraded":"2022-09-17T10:27:46.879652+0000","last_fullsized":"2022-09-17T10:27:46.879652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821818+0000","last_change":"2022-09-17T10:27:42.419293+0000","last_active":"2022-09-17T10:27:46.821818+0000","last_peered":"2022-09-17T10:27:46.821818+0000","last_clean":"2022-09-17T10:27:46.821818+0000","last_became_active":"2022-09-17T10:27:42.419016+0000","last_became_peered":"2022-09-17T10:27:42.419016+0000","last_unstale":"2022-09-17T10:27:46.821818+0000","last_undegraded":"2022-09-17T10:27:46.821818+0000","last_fullsized":"2022-09-17T10:27:46.821818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823777+0000","last_change":"2022-09-17T10:27:42.811222+0000","last_active":"2022-09-17T10:27:46.823777+0000","last_peered":"2022-09-17T10:27:46.823777+0000","last_clean":"2022-09-17T10:27:46.823777+0000","last_became_active":"2022-09-17T10:27:42.810431+0000","last_became_peered":"2022-09-17T10:27:42.810431+0000","last_unstale":"2022-09-17T10:27:46.823777+0000","last_undegraded":"2022-09-17T10:27:46.823777+0000","last_fullsized":"2022-09-17T10:27:46.823777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"26'1","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824396+0000","last_change":"2022-09-17T10:27:42.418764+0000","last_active":"2022-09-17T10:27:46.824396+0000","last_peered":"2022-09-17T10:27:46.824396+0000","last_clean":"2022-09-17T10:27:46.824396+0000","last_became_active":"2022-09-17T10:27:42.418460+0000","last_became_peered":"2022-09-17T10:27:42.418460+0000","last_unstale":"2022-09-17T10:27:46.824396+0000","last_undegraded":"2022-09-17T10:27:46.824396+0000","last_fullsized":"2022-09-17T10:27:46.824396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820837+0000","last_change":"2022-09-17T10:27:42.811297+0000","last_active":"2022-09-17T10:27:46.820837+0000","last_peered":"2022-09-17T10:27:46.820837+0000","last_clean":"2022-09-17T10:27:46.820837+0000","last_became_active":"2022-09-17T10:27:42.810563+0000","last_became_peered":"2022-09-17T10:27:42.810563+0000","last_unstale":"2022-09-17T10:27:46.820837+0000","last_undegraded":"2022-09-17T10:27:46.820837+0000","last_fullsized":"2022-09-17T10:27:46.820837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.881583+0000","last_change":"2022-09-17T10:27:46.879898+0000","last_active":"2022-09-17T10:27:46.881583+0000","last_peered":"2022-09-17T10:27:46.881583+0000","last_clean":"2022-09-17T10:27:46.881583+0000","last_became_active":"2022-09-17T10:27:46.877842+0000","last_became_peered":"2022-09-17T10:27:46.877842+0000","last_unstale":"2022-09-17T10:27:46.881583+0000","last_undegraded":"2022-09-17T10:27:46.881583+0000","last_fullsized":"2022-09-17T10:27:46.881583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831170+0000","last_change":"2022-09-17T10:27:42.426206+0000","last_active":"2022-09-17T10:27:46.831170+0000","last_peered":"2022-09-17T10:27:46.831170+0000","last_clean":"2022-09-17T10:27:46.831170+0000","last_became_active":"2022-09-17T10:27:42.425534+0000","last_became_peered":"2022-09-17T10:27:42.425534+0000","last_unstale":"2022-09-17T10:27:46.831170+0000","last_undegraded":"2022-09-17T10:27:46.831170+0000","last_fullsized":"2022-09-17T10:27:46.831170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823594+0000","last_change":"2022-09-17T10:27:42.805131+0000","last_active":"2022-09-17T10:27:46.823594+0000","last_peered":"2022-09-17T10:27:46.823594+0000","last_clean":"2022-09-17T10:27:46.823594+0000","last_became_active":"2022-09-17T10:27:42.804846+0000","last_became_peered":"2022-09-17T10:27:42.804846+0000","last_unstale":"2022-09-17T10:27:46.823594+0000","last_undegraded":"2022-09-17T10:27:46.823594+0000","last_fullsized":"2022-09-17T10:27:46.823594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838709+0000","last_change":"2022-09-17T10:27:46.833771+0000","last_active":"2022-09-17T10:27:46.838709+0000","last_peered":"2022-09-17T10:27:46.838709+0000","last_clean":"2022-09-17T10:27:46.838709+0000","last_became_active":"2022-09-17T10:27:46.833345+0000","last_became_peered":"2022-09-17T10:27:46.833345+0000","last_unstale":"2022-09-17T10:27:46.838709+0000","last_undegraded":"2022-09-17T10:27:46.838709+0000","last_fullsized":"2022-09-17T10:27:46.838709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826554+0000","last_change":"2022-09-17T10:27:42.422308+0000","last_active":"2022-09-17T10:27:46.826554+0000","last_peered":"2022-09-17T10:27:46.826554+0000","last_clean":"2022-09-17T10:27:46.826554+0000","last_became_active":"2022-09-17T10:27:42.422019+0000","last_became_peered":"2022-09-17T10:27:42.422019+0000","last_unstale":"2022-09-17T10:27:46.826554+0000","last_undegraded":"2022-09-17T10:27:46.826554+0000","last_fullsized":"2022-09-17T10:27:46.826554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821083+0000","last_change":"2022-09-17T10:27:42.810397+0000","last_active":"2022-09-17T10:27:46.821083+0000","last_peered":"2022-09-17T10:27:46.821083+0000","last_clean":"2022-09-17T10:27:46.821083+0000","last_became_active":"2022-09-17T10:27:42.810076+0000","last_became_peered":"2022-09-17T10:27:42.810076+0000","last_unstale":"2022-09-17T10:27:46.821083+0000","last_undegraded":"2022-09-17T10:27:46.821083+0000","last_fullsized":"2022-09-17T10:27:46.821083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839292+0000","last_change":"2022-09-17T10:27:46.836157+0000","last_active":"2022-09-17T10:27:46.839292+0000","last_peered":"2022-09-17T10:27:46.839292+0000","last_clean":"2022-09-17T10:27:46.839292+0000","last_became_active":"2022-09-17T10:27:46.835717+0000","last_became_peered":"2022-09-17T10:27:46.835717+0000","last_unstale":"2022-09-17T10:27:46.839292+0000","last_undegraded":"2022-09-17T10:27:46.839292+0000","last_fullsized":"2022-09-17T10:27:46.839292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827850+0000","last_change":"2022-09-17T10:27:42.414705+0000","last_active":"2022-09-17T10:27:46.827850+0000","last_peered":"2022-09-17T10:27:46.827850+0000","last_clean":"2022-09-17T10:27:46.827850+0000","last_became_active":"2022-09-17T10:27:42.414385+0000","last_became_peered":"2022-09-17T10:27:42.414385+0000","last_unstale":"2022-09-17T10:27:46.827850+0000","last_undegraded":"2022-09-17T10:27:46.827850+0000","last_fullsized":"2022-09-17T10:27:46.827850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820968+0000","last_change":"2022-09-17T10:27:42.817114+0000","last_active":"2022-09-17T10:27:46.820968+0000","last_peered":"2022-09-17T10:27:46.820968+0000","last_clean":"2022-09-17T10:27:46.820968+0000","last_became_active":"2022-09-17T10:27:42.816803+0000","last_became_peered":"2022-09-17T10:27:42.816803+0000","last_unstale":"2022-09-17T10:27:46.820968+0000","last_undegraded":"2022-09-17T10:27:46.820968+0000","last_fullsized":"2022-09-17T10:27:46.820968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879975+0000","last_change":"2022-09-17T10:27:46.878852+0000","last_active":"2022-09-17T10:27:46.879975+0000","last_peered":"2022-09-17T10:27:46.879975+0000","last_clean":"2022-09-17T10:27:46.879975+0000","last_became_active":"2022-09-17T10:27:46.878402+0000","last_became_peered":"2022-09-17T10:27:46.878402+0000","last_unstale":"2022-09-17T10:27:46.879975+0000","last_undegraded":"2022-09-17T10:27:46.879975+0000","last_fullsized":"2022-09-17T10:27:46.879975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.882394+0000","last_change":"2022-09-17T10:27:46.880930+0000","last_active":"2022-09-17T10:27:46.882394+0000","last_peered":"2022-09-17T10:27:46.882394+0000","last_clean":"2022-09-17T10:27:46.882394+0000","last_became_active":"2022-09-17T10:27:46.880498+0000","last_became_peered":"2022-09-17T10:27:46.880498+0000","last_unstale":"2022-09-17T10:27:46.882394+0000","last_undegraded":"2022-09-17T10:27:46.882394+0000","last_fullsized":"2022-09-17T10:27:46.882394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828368+0000","last_change":"2022-09-17T10:27:42.422458+0000","last_active":"2022-09-17T10:27:46.828368+0000","last_peered":"2022-09-17T10:27:46.828368+0000","last_clean":"2022-09-17T10:27:46.828368+0000","last_became_active":"2022-09-17T10:27:42.422187+0000","last_became_peered":"2022-09-17T10:27:42.422187+0000","last_unstale":"2022-09-17T10:27:46.828368+0000","last_undegraded":"2022-09-17T10:27:46.828368+0000","last_fullsized":"2022-09-17T10:27:46.828368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825686+0000","last_change":"2022-09-17T10:27:42.806970+0000","last_active":"2022-09-17T10:27:46.825686+0000","last_peered":"2022-09-17T10:27:46.825686+0000","last_clean":"2022-09-17T10:27:46.825686+0000","last_became_active":"2022-09-17T10:27:42.806322+0000","last_became_peered":"2022-09-17T10:27:42.806322+0000","last_unstale":"2022-09-17T10:27:46.825686+0000","last_undegraded":"2022-09-17T10:27:46.825686+0000","last_fullsized":"2022-09-17T10:27:46.825686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823713+0000","last_change":"2022-09-17T10:27:42.812236+0000","last_active":"2022-09-17T10:27:46.823713+0000","last_peered":"2022-09-17T10:27:46.823713+0000","last_clean":"2022-09-17T10:27:46.823713+0000","last_became_active":"2022-09-17T10:27:42.811869+0000","last_became_peered":"2022-09-17T10:27:42.811869+0000","last_unstale":"2022-09-17T10:27:46.823713+0000","last_undegraded":"2022-09-17T10:27:46.823713+0000","last_fullsized":"2022-09-17T10:27:46.823713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823142+0000","last_change":"2022-09-17T10:27:42.423679+0000","last_active":"2022-09-17T10:27:46.823142+0000","last_peered":"2022-09-17T10:27:46.823142+0000","last_clean":"2022-09-17T10:27:46.823142+0000","last_became_active":"2022-09-17T10:27:42.423382+0000","last_became_peered":"2022-09-17T10:27:42.423382+0000","last_unstale":"2022-09-17T10:27:46.823142+0000","last_undegraded":"2022-09-17T10:27:46.823142+0000","last_fullsized":"2022-09-17T10:27:46.823142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821044+0000","last_change":"2022-09-17T10:27:37.393333+0000","last_active":"2022-09-17T10:27:46.821044+0000","last_peered":"2022-09-17T10:27:46.821044+0000","last_clean":"2022-09-17T10:27:46.821044+0000","last_became_active":"2022-09-17T10:27:37.393020+0000","last_became_peered":"2022-09-17T10:27:37.393020+0000","last_unstale":"2022-09-17T10:27:46.821044+0000","last_undegraded":"2022-09-17T10:27:46.821044+0000","last_fullsized":"2022-09-17T10:27:46.821044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.836043+0000","last_change":"2022-09-17T10:27:46.833138+0000","last_active":"2022-09-17T10:27:46.836043+0000","last_peered":"2022-09-17T10:27:46.836043+0000","last_clean":"2022-09-17T10:27:46.836043+0000","last_became_active":"2022-09-17T10:27:46.832732+0000","last_became_peered":"2022-09-17T10:27:46.832732+0000","last_unstale":"2022-09-17T10:27:46.836043+0000","last_undegraded":"2022-09-17T10:27:46.836043+0000","last_fullsized":"2022-09-17T10:27:46.836043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830521+0000","last_change":"2022-09-17T10:27:42.808357+0000","last_active":"2022-09-17T10:27:46.830521+0000","last_peered":"2022-09-17T10:27:46.830521+0000","last_clean":"2022-09-17T10:27:46.830521+0000","last_became_active":"2022-09-17T10:27:42.808087+0000","last_became_peered":"2022-09-17T10:27:42.808087+0000","last_unstale":"2022-09-17T10:27:46.830521+0000","last_undegraded":"2022-09-17T10:27:46.830521+0000","last_fullsized":"2022-09-17T10:27:46.830521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823635+0000","last_change":"2022-09-17T10:27:37.394630+0000","last_active":"2022-09-17T10:27:46.823635+0000","last_peered":"2022-09-17T10:27:46.823635+0000","last_clean":"2022-09-17T10:27:46.823635+0000","last_became_active":"2022-09-17T10:27:37.394313+0000","last_became_peered":"2022-09-17T10:27:37.394313+0000","last_unstale":"2022-09-17T10:27:46.823635+0000","last_undegraded":"2022-09-17T10:27:46.823635+0000","last_fullsized":"2022-09-17T10:27:46.823635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831821+0000","last_change":"2022-09-17T10:27:42.423502+0000","last_active":"2022-09-17T10:27:46.831821+0000","last_peered":"2022-09-17T10:27:46.831821+0000","last_clean":"2022-09-17T10:27:46.831821+0000","last_became_active":"2022-09-17T10:27:42.423217+0000","last_became_peered":"2022-09-17T10:27:42.423217+0000","last_unstale":"2022-09-17T10:27:46.831821+0000","last_undegraded":"2022-09-17T10:27:46.831821+0000","last_fullsized":"2022-09-17T10:27:46.831821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839878+0000","last_change":"2022-09-17T10:27:46.837673+0000","last_active":"2022-09-17T10:27:46.839878+0000","last_peered":"2022-09-17T10:27:46.839878+0000","last_clean":"2022-09-17T10:27:46.839878+0000","last_became_active":"2022-09-17T10:27:46.837297+0000","last_became_peered":"2022-09-17T10:27:46.837297+0000","last_unstale":"2022-09-17T10:27:46.839878+0000","last_undegraded":"2022-09-17T10:27:46.839878+0000","last_fullsized":"2022-09-17T10:27:46.839878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821835+0000","last_change":"2022-09-17T10:27:42.817158+0000","last_active":"2022-09-17T10:27:46.821835+0000","last_peered":"2022-09-17T10:27:46.821835+0000","last_clean":"2022-09-17T10:27:46.821835+0000","last_became_active":"2022-09-17T10:27:42.816865+0000","last_became_peered":"2022-09-17T10:27:42.816865+0000","last_unstale":"2022-09-17T10:27:46.821835+0000","last_undegraded":"2022-09-17T10:27:46.821835+0000","last_fullsized":"2022-09-17T10:27:46.821835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877323+0000","last_change":"2022-09-17T10:27:42.420110+0000","last_active":"2022-09-17T10:27:46.877323+0000","last_peered":"2022-09-17T10:27:46.877323+0000","last_clean":"2022-09-17T10:27:46.877323+0000","last_became_active":"2022-09-17T10:27:42.419792+0000","last_became_peered":"2022-09-17T10:27:42.419792+0000","last_unstale":"2022-09-17T10:27:46.877323+0000","last_undegraded":"2022-09-17T10:27:46.877323+0000","last_fullsized":"2022-09-17T10:27:46.877323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832869+0000","last_change":"2022-09-17T10:27:37.518568+0000","last_active":"2022-09-17T10:27:46.832869+0000","last_peered":"2022-09-17T10:27:46.832869+0000","last_clean":"2022-09-17T10:27:46.832869+0000","last_became_active":"2022-09-17T10:27:37.518118+0000","last_became_peered":"2022-09-17T10:27:37.518118+0000","last_unstale":"2022-09-17T10:27:46.832869+0000","last_undegraded":"2022-09-17T10:27:46.832869+0000","last_fullsized":"2022-09-17T10:27:46.832869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.834941+0000","last_change":"2022-09-17T10:27:46.830735+0000","last_active":"2022-09-17T10:27:46.834941+0000","last_peered":"2022-09-17T10:27:46.834941+0000","last_clean":"2022-09-17T10:27:46.834941+0000","last_became_active":"2022-09-17T10:27:46.830221+0000","last_became_peered":"2022-09-17T10:27:46.830221+0000","last_unstale":"2022-09-17T10:27:46.834941+0000","last_undegraded":"2022-09-17T10:27:46.834941+0000","last_fullsized":"2022-09-17T10:27:46.834941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876839+0000","last_change":"2022-09-17T10:27:42.417099+0000","last_active":"2022-09-17T10:27:46.876839+0000","last_peered":"2022-09-17T10:27:46.876839+0000","last_clean":"2022-09-17T10:27:46.876839+0000","last_became_active":"2022-09-17T10:27:42.416817+0000","last_became_peered":"2022-09-17T10:27:42.416817+0000","last_unstale":"2022-09-17T10:27:46.876839+0000","last_undegraded":"2022-09-17T10:27:46.876839+0000","last_fullsized":"2022-09-17T10:27:46.876839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831235+0000","last_change":"2022-09-17T10:27:37.519776+0000","last_active":"2022-09-17T10:27:46.831235+0000","last_peered":"2022-09-17T10:27:46.831235+0000","last_clean":"2022-09-17T10:27:46.831235+0000","last_became_active":"2022-09-17T10:27:37.519419+0000","last_became_peered":"2022-09-17T10:27:37.519419+0000","last_unstale":"2022-09-17T10:27:46.831235+0000","last_undegraded":"2022-09-17T10:27:46.831235+0000","last_fullsized":"2022-09-17T10:27:46.831235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826040+0000","last_change":"2022-09-17T10:27:42.818131+0000","last_active":"2022-09-17T10:27:46.826040+0000","last_peered":"2022-09-17T10:27:46.826040+0000","last_clean":"2022-09-17T10:27:46.826040+0000","last_became_active":"2022-09-17T10:27:42.817852+0000","last_became_peered":"2022-09-17T10:27:42.817852+0000","last_unstale":"2022-09-17T10:27:46.826040+0000","last_undegraded":"2022-09-17T10:27:46.826040+0000","last_fullsized":"2022-09-17T10:27:46.826040+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838321+0000","last_change":"2022-09-17T10:27:46.836570+0000","last_active":"2022-09-17T10:27:46.838321+0000","last_peered":"2022-09-17T10:27:46.838321+0000","last_clean":"2022-09-17T10:27:46.838321+0000","last_became_active":"2022-09-17T10:27:46.836058+0000","last_became_peered":"2022-09-17T10:27:46.836058+0000","last_unstale":"2022-09-17T10:27:46.838321+0000","last_undegraded":"2022-09-17T10:27:46.838321+0000","last_fullsized":"2022-09-17T10:27:46.838321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831209+0000","last_change":"2022-09-17T10:27:42.421065+0000","last_active":"2022-09-17T10:27:46.831209+0000","last_peered":"2022-09-17T10:27:46.831209+0000","last_clean":"2022-09-17T10:27:46.831209+0000","last_became_active":"2022-09-17T10:27:42.420726+0000","last_became_peered":"2022-09-17T10:27:42.420726+0000","last_unstale":"2022-09-17T10:27:46.831209+0000","last_undegraded":"2022-09-17T10:27:46.831209+0000","last_fullsized":"2022-09-17T10:27:46.831209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826418+0000","last_change":"2022-09-17T10:27:34.683645+0000","last_active":"2022-09-17T10:27:46.826418+0000","last_peered":"2022-09-17T10:27:46.826418+0000","last_clean":"2022-09-17T10:27:46.826418+0000","last_became_active":"2022-09-17T10:27:34.683343+0000","last_became_peered":"2022-09-17T10:27:34.683343+0000","last_unstale":"2022-09-17T10:27:46.826418+0000","last_undegraded":"2022-09-17T10:27:46.826418+0000","last_fullsized":"2022-09-17T10:27:46.826418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:33.351685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:33.351685+0000","last_clean_scrub_stamp":"2022-09-17T10:27:33.351685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820922+0000","last_change":"2022-09-17T10:27:37.392686+0000","last_active":"2022-09-17T10:27:46.820922+0000","last_peered":"2022-09-17T10:27:46.820922+0000","last_clean":"2022-09-17T10:27:46.820922+0000","last_became_active":"2022-09-17T10:27:37.392465+0000","last_became_peered":"2022-09-17T10:27:37.392465+0000","last_unstale":"2022-09-17T10:27:46.820922+0000","last_undegraded":"2022-09-17T10:27:46.820922+0000","last_fullsized":"2022-09-17T10:27:46.820922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828213+0000","last_change":"2022-09-17T10:27:42.817727+0000","last_active":"2022-09-17T10:27:46.828213+0000","last_peered":"2022-09-17T10:27:46.828213+0000","last_clean":"2022-09-17T10:27:46.828213+0000","last_became_active":"2022-09-17T10:27:42.817394+0000","last_became_peered":"2022-09-17T10:27:42.817394+0000","last_unstale":"2022-09-17T10:27:46.828213+0000","last_undegraded":"2022-09-17T10:27:46.828213+0000","last_fullsized":"2022-09-17T10:27:46.828213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879456+0000","last_change":"2022-09-17T10:27:46.878670+0000","last_active":"2022-09-17T10:27:46.879456+0000","last_peered":"2022-09-17T10:27:46.879456+0000","last_clean":"2022-09-17T10:27:46.879456+0000","last_became_active":"2022-09-17T10:27:46.878229+0000","last_became_peered":"2022-09-17T10:27:46.878229+0000","last_unstale":"2022-09-17T10:27:46.879456+0000","last_undegraded":"2022-09-17T10:27:46.879456+0000","last_fullsized":"2022-09-17T10:27:46.879456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826285+0000","last_change":"2022-09-17T10:27:42.419675+0000","last_active":"2022-09-17T10:27:46.826285+0000","last_peered":"2022-09-17T10:27:46.826285+0000","last_clean":"2022-09-17T10:27:46.826285+0000","last_became_active":"2022-09-17T10:27:42.419276+0000","last_became_peered":"2022-09-17T10:27:42.419276+0000","last_unstale":"2022-09-17T10:27:46.826285+0000","last_undegraded":"2022-09-17T10:27:46.826285+0000","last_fullsized":"2022-09-17T10:27:46.826285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876695+0000","last_change":"2022-09-17T10:27:37.518223+0000","last_active":"2022-09-17T10:27:46.876695+0000","last_peered":"2022-09-17T10:27:46.876695+0000","last_clean":"2022-09-17T10:27:46.876695+0000","last_became_active":"2022-09-17T10:27:37.517883+0000","last_became_peered":"2022-09-17T10:27:37.517883+0000","last_unstale":"2022-09-17T10:27:46.876695+0000","last_undegraded":"2022-09-17T10:27:46.876695+0000","last_fullsized":"2022-09-17T10:27:46.876695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.878284+0000","last_change":"2022-09-17T10:27:42.817484+0000","last_active":"2022-09-17T10:27:46.878284+0000","last_peered":"2022-09-17T10:27:46.878284+0000","last_clean":"2022-09-17T10:27:46.878284+0000","last_became_active":"2022-09-17T10:27:42.817192+0000","last_became_peered":"2022-09-17T10:27:42.817192+0000","last_unstale":"2022-09-17T10:27:46.878284+0000","last_undegraded":"2022-09-17T10:27:46.878284+0000","last_fullsized":"2022-09-17T10:27:46.878284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879275+0000","last_change":"2022-09-17T10:27:46.878284+0000","last_active":"2022-09-17T10:27:46.879275+0000","last_peered":"2022-09-17T10:27:46.879275+0000","last_clean":"2022-09-17T10:27:46.879275+0000","last_became_active":"2022-09-17T10:27:46.877826+0000","last_became_peered":"2022-09-17T10:27:46.877826+0000","last_unstale":"2022-09-17T10:27:46.879275+0000","last_undegraded":"2022-09-17T10:27:46.879275+0000","last_fullsized":"2022-09-17T10:27:46.879275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877241+0000","last_change":"2022-09-17T10:27:42.805395+0000","last_active":"2022-09-17T10:27:46.877241+0000","last_peered":"2022-09-17T10:27:46.877241+0000","last_clean":"2022-09-17T10:27:46.877241+0000","last_became_active":"2022-09-17T10:27:42.805072+0000","last_became_peered":"2022-09-17T10:27:42.805072+0000","last_unstale":"2022-09-17T10:27:46.877241+0000","last_undegraded":"2022-09-17T10:27:46.877241+0000","last_fullsized":"2022-09-17T10:27:46.877241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823138+0000","last_change":"2022-09-17T10:27:42.422220+0000","last_active":"2022-09-17T10:27:46.823138+0000","last_peered":"2022-09-17T10:27:46.823138+0000","last_clean":"2022-09-17T10:27:46.823138+0000","last_became_active":"2022-09-17T10:27:42.421941+0000","last_became_peered":"2022-09-17T10:27:42.421941+0000","last_unstale":"2022-09-17T10:27:46.823138+0000","last_undegraded":"2022-09-17T10:27:46.823138+0000","last_fullsized":"2022-09-17T10:27:46.823138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827201+0000","last_change":"2022-09-17T10:27:37.394582+0000","last_active":"2022-09-17T10:27:46.827201+0000","last_peered":"2022-09-17T10:27:46.827201+0000","last_clean":"2022-09-17T10:27:46.827201+0000","last_became_active":"2022-09-17T10:27:37.394285+0000","last_became_peered":"2022-09-17T10:27:37.394285+0000","last_unstale":"2022-09-17T10:27:46.827201+0000","last_undegraded":"2022-09-17T10:27:46.827201+0000","last_fullsized":"2022-09-17T10:27:46.827201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.881600+0000","last_change":"2022-09-17T10:27:46.880385+0000","last_active":"2022-09-17T10:27:46.881600+0000","last_peered":"2022-09-17T10:27:46.881600+0000","last_clean":"2022-09-17T10:27:46.881600+0000","last_became_active":"2022-09-17T10:27:46.878700+0000","last_became_peered":"2022-09-17T10:27:46.878700+0000","last_unstale":"2022-09-17T10:27:46.881600+0000","last_undegraded":"2022-09-17T10:27:46.881600+0000","last_fullsized":"2022-09-17T10:27:46.881600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832695+0000","last_change":"2022-09-17T10:27:42.817890+0000","last_active":"2022-09-17T10:27:46.832695+0000","last_peered":"2022-09-17T10:27:46.832695+0000","last_clean":"2022-09-17T10:27:46.832695+0000","last_became_active":"2022-09-17T10:27:42.817601+0000","last_became_peered":"2022-09-17T10:27:42.817601+0000","last_unstale":"2022-09-17T10:27:46.832695+0000","last_undegraded":"2022-09-17T10:27:46.832695+0000","last_fullsized":"2022-09-17T10:27:46.832695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823749+0000","last_change":"2022-09-17T10:27:42.423365+0000","last_active":"2022-09-17T10:27:46.823749+0000","last_peered":"2022-09-17T10:27:46.823749+0000","last_clean":"2022-09-17T10:27:46.823749+0000","last_became_active":"2022-09-17T10:27:42.423033+0000","last_became_peered":"2022-09-17T10:27:42.423033+0000","last_unstale":"2022-09-17T10:27:46.823749+0000","last_undegraded":"2022-09-17T10:27:46.823749+0000","last_fullsized":"2022-09-17T10:27:46.823749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823623+0000","last_change":"2022-09-17T10:27:37.525398+0000","last_active":"2022-09-17T10:27:46.823623+0000","last_peered":"2022-09-17T10:27:46.823623+0000","last_clean":"2022-09-17T10:27:46.823623+0000","last_became_active":"2022-09-17T10:27:37.525103+0000","last_became_peered":"2022-09-17T10:27:37.525103+0000","last_unstale":"2022-09-17T10:27:46.823623+0000","last_undegraded":"2022-09-17T10:27:46.823623+0000","last_fullsized":"2022-09-17T10:27:46.823623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879752+0000","last_change":"2022-09-17T10:27:46.877751+0000","last_active":"2022-09-17T10:27:46.879752+0000","last_peered":"2022-09-17T10:27:46.879752+0000","last_clean":"2022-09-17T10:27:46.879752+0000","last_became_active":"2022-09-17T10:27:46.877299+0000","last_became_peered":"2022-09-17T10:27:46.877299+0000","last_unstale":"2022-09-17T10:27:46.879752+0000","last_undegraded":"2022-09-17T10:27:46.879752+0000","last_fullsized":"2022-09-17T10:27:46.879752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823812+0000","last_change":"2022-09-17T10:27:42.420366+0000","last_active":"2022-09-17T10:27:46.823812+0000","last_peered":"2022-09-17T10:27:46.823812+0000","last_clean":"2022-09-17T10:27:46.823812+0000","last_became_active":"2022-09-17T10:27:42.420013+0000","last_became_peered":"2022-09-17T10:27:42.420013+0000","last_unstale":"2022-09-17T10:27:46.823812+0000","last_undegraded":"2022-09-17T10:27:46.823812+0000","last_fullsized":"2022-09-17T10:27:46.823812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824918+0000","last_change":"2022-09-17T10:27:42.806721+0000","last_active":"2022-09-17T10:27:46.824918+0000","last_peered":"2022-09-17T10:27:46.824918+0000","last_clean":"2022-09-17T10:27:46.824918+0000","last_became_active":"2022-09-17T10:27:42.806357+0000","last_became_peered":"2022-09-17T10:27:42.806357+0000","last_unstale":"2022-09-17T10:27:46.824918+0000","last_undegraded":"2022-09-17T10:27:46.824918+0000","last_fullsized":"2022-09-17T10:27:46.824918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.882851+0000","last_change":"2022-09-17T10:27:46.882310+0000","last_active":"2022-09-17T10:27:46.882851+0000","last_peered":"2022-09-17T10:27:46.882851+0000","last_clean":"2022-09-17T10:27:46.882851+0000","last_became_active":"2022-09-17T10:27:46.881958+0000","last_became_peered":"2022-09-17T10:27:46.881958+0000","last_unstale":"2022-09-17T10:27:46.882851+0000","last_undegraded":"2022-09-17T10:27:46.882851+0000","last_fullsized":"2022-09-17T10:27:46.882851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832635+0000","last_change":"2022-09-17T10:27:42.420727+0000","last_active":"2022-09-17T10:27:46.832635+0000","last_peered":"2022-09-17T10:27:46.832635+0000","last_clean":"2022-09-17T10:27:46.832635+0000","last_became_active":"2022-09-17T10:27:42.420318+0000","last_became_peered":"2022-09-17T10:27:42.420318+0000","last_unstale":"2022-09-17T10:27:46.832635+0000","last_undegraded":"2022-09-17T10:27:46.832635+0000","last_fullsized":"2022-09-17T10:27:46.832635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821086+0000","last_change":"2022-09-17T10:27:42.816236+0000","last_active":"2022-09-17T10:27:46.821086+0000","last_peered":"2022-09-17T10:27:46.821086+0000","last_clean":"2022-09-17T10:27:46.821086+0000","last_became_active":"2022-09-17T10:27:42.815964+0000","last_became_peered":"2022-09-17T10:27:42.815964+0000","last_unstale":"2022-09-17T10:27:46.821086+0000","last_undegraded":"2022-09-17T10:27:46.821086+0000","last_fullsized":"2022-09-17T10:27:46.821086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838996+0000","last_change":"2022-09-17T10:27:46.833473+0000","last_active":"2022-09-17T10:27:46.838996+0000","last_peered":"2022-09-17T10:27:46.838996+0000","last_clean":"2022-09-17T10:27:46.838996+0000","last_became_active":"2022-09-17T10:27:46.832774+0000","last_became_peered":"2022-09-17T10:27:46.832774+0000","last_unstale":"2022-09-17T10:27:46.838996+0000","last_undegraded":"2022-09-17T10:27:46.838996+0000","last_fullsized":"2022-09-17T10:27:46.838996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826647+0000","last_change":"2022-09-17T10:27:42.417006+0000","last_active":"2022-09-17T10:27:46.826647+0000","last_peered":"2022-09-17T10:27:46.826647+0000","last_clean":"2022-09-17T10:27:46.826647+0000","last_became_active":"2022-09-17T10:27:42.416679+0000","last_became_peered":"2022-09-17T10:27:42.416679+0000","last_unstale":"2022-09-17T10:27:46.826647+0000","last_undegraded":"2022-09-17T10:27:46.826647+0000","last_fullsized":"2022-09-17T10:27:46.826647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821361+0000","last_change":"2022-09-17T10:27:42.814951+0000","last_active":"2022-09-17T10:27:46.821361+0000","last_peered":"2022-09-17T10:27:46.821361+0000","last_clean":"2022-09-17T10:27:46.821361+0000","last_became_active":"2022-09-17T10:27:42.814659+0000","last_became_peered":"2022-09-17T10:27:42.814659+0000","last_unstale":"2022-09-17T10:27:46.821361+0000","last_undegraded":"2022-09-17T10:27:46.821361+0000","last_fullsized":"2022-09-17T10:27:46.821361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.836181+0000","last_change":"2022-09-17T10:27:46.835414+0000","last_active":"2022-09-17T10:27:46.836181+0000","last_peered":"2022-09-17T10:27:46.836181+0000","last_clean":"2022-09-17T10:27:46.836181+0000","last_became_active":"2022-09-17T10:27:46.834968+0000","last_became_peered":"2022-09-17T10:27:46.834968+0000","last_unstale":"2022-09-17T10:27:46.836181+0000","last_undegraded":"2022-09-17T10:27:46.836181+0000","last_fullsized":"2022-09-17T10:27:46.836181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830835+0000","last_change":"2022-09-17T10:27:42.422793+0000","last_active":"2022-09-17T10:27:46.830835+0000","last_peered":"2022-09-17T10:27:46.830835+0000","last_clean":"2022-09-17T10:27:46.830835+0000","last_became_active":"2022-09-17T10:27:42.422337+0000","last_became_peered":"2022-09-17T10:27:42.422337+0000","last_unstale":"2022-09-17T10:27:46.830835+0000","last_undegraded":"2022-09-17T10:27:46.830835+0000","last_fullsized":"2022-09-17T10:27:46.830835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822194+0000","last_change":"2022-09-17T10:27:42.811550+0000","last_active":"2022-09-17T10:27:46.822194+0000","last_peered":"2022-09-17T10:27:46.822194+0000","last_clean":"2022-09-17T10:27:46.822194+0000","last_became_active":"2022-09-17T10:27:42.811253+0000","last_became_peered":"2022-09-17T10:27:42.811253+0000","last_unstale":"2022-09-17T10:27:46.822194+0000","last_undegraded":"2022-09-17T10:27:46.822194+0000","last_fullsized":"2022-09-17T10:27:46.822194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838391+0000","last_change":"2022-09-17T10:27:46.835511+0000","last_active":"2022-09-17T10:27:46.838391+0000","last_peered":"2022-09-17T10:27:46.838391+0000","last_clean":"2022-09-17T10:27:46.838391+0000","last_became_active":"2022-09-17T10:27:46.835134+0000","last_became_peered":"2022-09-17T10:27:46.835134+0000","last_unstale":"2022-09-17T10:27:46.838391+0000","last_undegraded":"2022-09-17T10:27:46.838391+0000","last_fullsized":"2022-09-17T10:27:46.838391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826910+0000","last_change":"2022-09-17T10:27:42.422231+0000","last_active":"2022-09-17T10:27:46.826910+0000","last_peered":"2022-09-17T10:27:46.826910+0000","last_clean":"2022-09-17T10:27:46.826910+0000","last_became_active":"2022-09-17T10:27:42.421108+0000","last_became_peered":"2022-09-17T10:27:42.421108+0000","last_unstale":"2022-09-17T10:27:46.826910+0000","last_undegraded":"2022-09-17T10:27:46.826910+0000","last_fullsized":"2022-09-17T10:27:46.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824550+0000","last_change":"2022-09-17T10:27:42.806733+0000","last_active":"2022-09-17T10:27:46.824550+0000","last_peered":"2022-09-17T10:27:46.824550+0000","last_clean":"2022-09-17T10:27:46.824550+0000","last_became_active":"2022-09-17T10:27:42.806446+0000","last_became_peered":"2022-09-17T10:27:42.806446+0000","last_unstale":"2022-09-17T10:27:46.824550+0000","last_undegraded":"2022-09-17T10:27:46.824550+0000","last_fullsized":"2022-09-17T10:27:46.824550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839217+0000","last_change":"2022-09-17T10:27:46.836402+0000","last_active":"2022-09-17T10:27:46.839217+0000","last_peered":"2022-09-17T10:27:46.839217+0000","last_clean":"2022-09-17T10:27:46.839217+0000","last_became_active":"2022-09-17T10:27:46.836002+0000","last_became_peered":"2022-09-17T10:27:46.836002+0000","last_unstale":"2022-09-17T10:27:46.839217+0000","last_undegraded":"2022-09-17T10:27:46.839217+0000","last_fullsized":"2022-09-17T10:27:46.839217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828495+0000","last_change":"2022-09-17T10:27:42.421493+0000","last_active":"2022-09-17T10:27:46.828495+0000","last_peered":"2022-09-17T10:27:46.828495+0000","last_clean":"2022-09-17T10:27:46.828495+0000","last_became_active":"2022-09-17T10:27:42.421137+0000","last_became_peered":"2022-09-17T10:27:42.421137+0000","last_unstale":"2022-09-17T10:27:46.828495+0000","last_undegraded":"2022-09-17T10:27:46.828495+0000","last_fullsized":"2022-09-17T10:27:46.828495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828502+0000","last_change":"2022-09-17T10:27:42.812206+0000","last_active":"2022-09-17T10:27:46.828502+0000","last_peered":"2022-09-17T10:27:46.828502+0000","last_clean":"2022-09-17T10:27:46.828502+0000","last_became_active":"2022-09-17T10:27:42.811911+0000","last_became_peered":"2022-09-17T10:27:42.811911+0000","last_unstale":"2022-09-17T10:27:46.828502+0000","last_undegraded":"2022-09-17T10:27:46.828502+0000","last_fullsized":"2022-09-17T10:27:46.828502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.837793+0000","last_change":"2022-09-17T10:27:46.836695+0000","last_active":"2022-09-17T10:27:46.837793+0000","last_peered":"2022-09-17T10:27:46.837793+0000","last_clean":"2022-09-17T10:27:46.837793+0000","last_became_active":"2022-09-17T10:27:46.836236+0000","last_became_peered":"2022-09-17T10:27:46.836236+0000","last_unstale":"2022-09-17T10:27:46.837793+0000","last_undegraded":"2022-09-17T10:27:46.837793+0000","last_fullsized":"2022-09-17T10:27:46.837793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822969+0000","last_change":"2022-09-17T10:27:42.418839+0000","last_active":"2022-09-17T10:27:46.822969+0000","last_peered":"2022-09-17T10:27:46.822969+0000","last_clean":"2022-09-17T10:27:46.822969+0000","last_became_active":"2022-09-17T10:27:42.418555+0000","last_became_peered":"2022-09-17T10:27:42.418555+0000","last_unstale":"2022-09-17T10:27:46.822969+0000","last_undegraded":"2022-09-17T10:27:46.822969+0000","last_fullsized":"2022-09-17T10:27:46.822969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825849+0000","last_change":"2022-09-17T10:27:42.820270+0000","last_active":"2022-09-17T10:27:46.825849+0000","last_peered":"2022-09-17T10:27:46.825849+0000","last_clean":"2022-09-17T10:27:46.825849+0000","last_became_active":"2022-09-17T10:27:42.820082+0000","last_became_peered":"2022-09-17T10:27:42.820082+0000","last_unstale":"2022-09-17T10:27:46.825849+0000","last_undegraded":"2022-09-17T10:27:46.825849+0000","last_fullsized":"2022-09-17T10:27:46.825849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832187+0000","last_change":"2022-09-17T10:27:46.830924+0000","last_active":"2022-09-17T10:27:46.832187+0000","last_peered":"2022-09-17T10:27:46.832187+0000","last_clean":"2022-09-17T10:27:46.832187+0000","last_became_active":"2022-09-17T10:27:46.830492+0000","last_became_peered":"2022-09-17T10:27:46.830492+0000","last_unstale":"2022-09-17T10:27:46.832187+0000","last_undegraded":"2022-09-17T10:27:46.832187+0000","last_fullsized":"2022-09-17T10:27:46.832187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830951+0000","last_change":"2022-09-17T10:27:42.419790+0000","last_active":"2022-09-17T10:27:46.830951+0000","last_peered":"2022-09-17T10:27:46.830951+0000","last_clean":"2022-09-17T10:27:46.830951+0000","last_became_active":"2022-09-17T10:27:42.419230+0000","last_became_peered":"2022-09-17T10:27:42.419230+0000","last_unstale":"2022-09-17T10:27:46.830951+0000","last_undegraded":"2022-09-17T10:27:46.830951+0000","last_fullsized":"2022-09-17T10:27:46.830951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825970+0000","last_change":"2022-09-17T10:27:42.818878+0000","last_active":"2022-09-17T10:27:46.825970+0000","last_peered":"2022-09-17T10:27:46.825970+0000","last_clean":"2022-09-17T10:27:46.825970+0000","last_became_active":"2022-09-17T10:27:42.818634+0000","last_became_peered":"2022-09-17T10:27:42.818634+0000","last_unstale":"2022-09-17T10:27:46.825970+0000","last_undegraded":"2022-09-17T10:27:46.825970+0000","last_fullsized":"2022-09-17T10:27:46.825970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839835+0000","last_change":"2022-09-17T10:27:46.832459+0000","last_active":"2022-09-17T10:27:46.839835+0000","last_peered":"2022-09-17T10:27:46.839835+0000","last_clean":"2022-09-17T10:27:46.839835+0000","last_became_active":"2022-09-17T10:27:46.831882+0000","last_became_peered":"2022-09-17T10:27:46.831882+0000","last_unstale":"2022-09-17T10:27:46.839835+0000","last_undegraded":"2022-09-17T10:27:46.839835+0000","last_fullsized":"2022-09-17T10:27:46.839835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"26'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826302+0000","last_change":"2022-09-17T10:27:42.418968+0000","last_active":"2022-09-17T10:27:46.826302+0000","last_peered":"2022-09-17T10:27:46.826302+0000","last_clean":"2022-09-17T10:27:46.826302+0000","last_became_active":"2022-09-17T10:27:42.418688+0000","last_became_peered":"2022-09-17T10:27:42.418688+0000","last_unstale":"2022-09-17T10:27:46.826302+0000","last_undegraded":"2022-09-17T10:27:46.826302+0000","last_fullsized":"2022-09-17T10:27:46.826302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824990+0000","last_change":"2022-09-17T10:27:42.811058+0000","last_active":"2022-09-17T10:27:46.824990+0000","last_peered":"2022-09-17T10:27:46.824990+0000","last_clean":"2022-09-17T10:27:46.824990+0000","last_became_active":"2022-09-17T10:27:42.810786+0000","last_became_peered":"2022-09-17T10:27:42.810786+0000","last_unstale":"2022-09-17T10:27:46.824990+0000","last_undegraded":"2022-09-17T10:27:46.824990+0000","last_fullsized":"2022-09-17T10:27:46.824990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879743+0000","last_change":"2022-09-17T10:27:46.878357+0000","last_active":"2022-09-17T10:27:46.879743+0000","last_peered":"2022-09-17T10:27:46.879743+0000","last_clean":"2022-09-17T10:27:46.879743+0000","last_became_active":"2022-09-17T10:27:46.877905+0000","last_became_peered":"2022-09-17T10:27:46.877905+0000","last_unstale":"2022-09-17T10:27:46.879743+0000","last_undegraded":"2022-09-17T10:27:46.879743+0000","last_fullsized":"2022-09-17T10:27:46.879743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825843+0000","last_change":"2022-09-17T10:27:42.423000+0000","last_active":"2022-09-17T10:27:46.825843+0000","last_peered":"2022-09-17T10:27:46.825843+0000","last_clean":"2022-09-17T10:27:46.825843+0000","last_became_active":"2022-09-17T10:27:42.422682+0000","last_became_peered":"2022-09-17T10:27:42.422682+0000","last_unstale":"2022-09-17T10:27:46.825843+0000","last_undegraded":"2022-09-17T10:27:46.825843+0000","last_fullsized":"2022-09-17T10:27:46.825843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879543+0000","last_change":"2022-09-17T10:27:42.811159+0000","last_active":"2022-09-17T10:27:46.879543+0000","last_peered":"2022-09-17T10:27:46.879543+0000","last_clean":"2022-09-17T10:27:46.879543+0000","last_became_active":"2022-09-17T10:27:42.810820+0000","last_became_peered":"2022-09-17T10:27:42.810820+0000","last_unstale":"2022-09-17T10:27:46.879543+0000","last_undegraded":"2022-09-17T10:27:46.879543+0000","last_fullsized":"2022-09-17T10:27:46.879543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839921+0000","last_change":"2022-09-17T10:27:46.838653+0000","last_active":"2022-09-17T10:27:46.839921+0000","last_peered":"2022-09-17T10:27:46.839921+0000","last_clean":"2022-09-17T10:27:46.839921+0000","last_became_active":"2022-09-17T10:27:46.838287+0000","last_became_peered":"2022-09-17T10:27:46.838287+0000","last_unstale":"2022-09-17T10:27:46.839921+0000","last_undegraded":"2022-09-17T10:27:46.839921+0000","last_fullsized":"2022-09-17T10:27:46.839921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877630+0000","last_change":"2022-09-17T10:27:42.419648+0000","last_active":"2022-09-17T10:27:46.877630+0000","last_peered":"2022-09-17T10:27:46.877630+0000","last_clean":"2022-09-17T10:27:46.877630+0000","last_became_active":"2022-09-17T10:27:42.419364+0000","last_became_peered":"2022-09-17T10:27:42.419364+0000","last_unstale":"2022-09-17T10:27:46.877630+0000","last_undegraded":"2022-09-17T10:27:46.877630+0000","last_fullsized":"2022-09-17T10:27:46.877630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826647+0000","last_change":"2022-09-17T10:27:42.816825+0000","last_active":"2022-09-17T10:27:46.826647+0000","last_peered":"2022-09-17T10:27:46.826647+0000","last_clean":"2022-09-17T10:27:46.826647+0000","last_became_active":"2022-09-17T10:27:42.816570+0000","last_became_peered":"2022-09-17T10:27:42.816570+0000","last_unstale":"2022-09-17T10:27:46.826647+0000","last_undegraded":"2022-09-17T10:27:46.826647+0000","last_fullsized":"2022-09-17T10:27:46.826647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841041+0000","last_change":"2022-09-17T10:27:46.840020+0000","last_active":"2022-09-17T10:27:46.841041+0000","last_peered":"2022-09-17T10:27:46.841041+0000","last_clean":"2022-09-17T10:27:46.841041+0000","last_became_active":"2022-09-17T10:27:46.839506+0000","last_became_peered":"2022-09-17T10:27:46.839506+0000","last_unstale":"2022-09-17T10:27:46.841041+0000","last_undegraded":"2022-09-17T10:27:46.841041+0000","last_fullsized":"2022-09-17T10:27:46.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825124+0000","last_change":"2022-09-17T10:27:42.422080+0000","last_active":"2022-09-17T10:27:46.825124+0000","last_peered":"2022-09-17T10:27:46.825124+0000","last_clean":"2022-09-17T10:27:46.825124+0000","last_became_active":"2022-09-17T10:27:42.421800+0000","last_became_peered":"2022-09-17T10:27:42.421800+0000","last_unstale":"2022-09-17T10:27:46.825124+0000","last_undegraded":"2022-09-17T10:27:46.825124+0000","last_fullsized":"2022-09-17T10:27:46.825124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822002+0000","last_change":"2022-09-17T10:27:42.813833+0000","last_active":"2022-09-17T10:27:46.822002+0000","last_peered":"2022-09-17T10:27:46.822002+0000","last_clean":"2022-09-17T10:27:46.822002+0000","last_became_active":"2022-09-17T10:27:42.813026+0000","last_became_peered":"2022-09-17T10:27:42.813026+0000","last_unstale":"2022-09-17T10:27:46.822002+0000","last_undegraded":"2022-09-17T10:27:46.822002+0000","last_fullsized":"2022-09-17T10:27:46.822002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838329+0000","last_change":"2022-09-17T10:27:46.836347+0000","last_active":"2022-09-17T10:27:46.838329+0000","last_peered":"2022-09-17T10:27:46.838329+0000","last_clean":"2022-09-17T10:27:46.838329+0000","last_became_active":"2022-09-17T10:27:46.835868+0000","last_became_peered":"2022-09-17T10:27:46.835868+0000","last_unstale":"2022-09-17T10:27:46.838329+0000","last_undegraded":"2022-09-17T10:27:46.838329+0000","last_fullsized":"2022-09-17T10:27:46.838329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827978+0000","last_change":"2022-09-17T10:27:42.418108+0000","last_active":"2022-09-17T10:27:46.827978+0000","last_peered":"2022-09-17T10:27:46.827978+0000","last_clean":"2022-09-17T10:27:46.827978+0000","last_became_active":"2022-09-17T10:27:42.417757+0000","last_became_peered":"2022-09-17T10:27:42.417757+0000","last_unstale":"2022-09-17T10:27:46.827978+0000","last_undegraded":"2022-09-17T10:27:46.827978+0000","last_fullsized":"2022-09-17T10:27:46.827978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821123+0000","last_change":"2022-09-17T10:27:42.817463+0000","last_active":"2022-09-17T10:27:46.821123+0000","last_peered":"2022-09-17T10:27:46.821123+0000","last_clean":"2022-09-17T10:27:46.821123+0000","last_became_active":"2022-09-17T10:27:42.816834+0000","last_became_peered":"2022-09-17T10:27:42.816834+0000","last_unstale":"2022-09-17T10:27:46.821123+0000","last_undegraded":"2022-09-17T10:27:46.821123+0000","last_fullsized":"2022-09-17T10:27:46.821123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841734+0000","last_change":"2022-09-17T10:27:46.841024+0000","last_active":"2022-09-17T10:27:46.841734+0000","last_peered":"2022-09-17T10:27:46.841734+0000","last_clean":"2022-09-17T10:27:46.841734+0000","last_became_active":"2022-09-17T10:27:46.840603+0000","last_became_peered":"2022-09-17T10:27:46.840603+0000","last_unstale":"2022-09-17T10:27:46.841734+0000","last_undegraded":"2022-09-17T10:27:46.841734+0000","last_fullsized":"2022-09-17T10:27:46.841734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"26'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832780+0000","last_change":"2022-09-17T10:27:42.420701+0000","last_active":"2022-09-17T10:27:46.832780+0000","last_peered":"2022-09-17T10:27:46.832780+0000","last_clean":"2022-09-17T10:27:46.832780+0000","last_became_active":"2022-09-17T10:27:42.420411+0000","last_became_peered":"2022-09-17T10:27:42.420411+0000","last_unstale":"2022-09-17T10:27:46.832780+0000","last_undegraded":"2022-09-17T10:27:46.832780+0000","last_fullsized":"2022-09-17T10:27:46.832780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824113+0000","last_change":"2022-09-17T10:27:42.815787+0000","last_active":"2022-09-17T10:27:46.824113+0000","last_peered":"2022-09-17T10:27:46.824113+0000","last_clean":"2022-09-17T10:27:46.824113+0000","last_became_active":"2022-09-17T10:27:42.815574+0000","last_became_peered":"2022-09-17T10:27:42.815574+0000","last_unstale":"2022-09-17T10:27:46.824113+0000","last_undegraded":"2022-09-17T10:27:46.824113+0000","last_fullsized":"2022-09-17T10:27:46.824113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841390+0000","last_change":"2022-09-17T10:27:46.840878+0000","last_active":"2022-09-17T10:27:46.841390+0000","last_peered":"2022-09-17T10:27:46.841390+0000","last_clean":"2022-09-17T10:27:46.841390+0000","last_became_active":"2022-09-17T10:27:46.840406+0000","last_became_peered":"2022-09-17T10:27:46.840406+0000","last_unstale":"2022-09-17T10:27:46.841390+0000","last_undegraded":"2022-09-17T10:27:46.841390+0000","last_fullsized":"2022-09-17T10:27:46.841390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.829101+0000","last_change":"2022-09-17T10:27:42.416329+0000","last_active":"2022-09-17T10:27:46.829101+0000","last_peered":"2022-09-17T10:27:46.829101+0000","last_clean":"2022-09-17T10:27:46.829101+0000","last_became_active":"2022-09-17T10:27:42.415993+0000","last_became_peered":"2022-09-17T10:27:42.415993+0000","last_unstale":"2022-09-17T10:27:46.829101+0000","last_undegraded":"2022-09-17T10:27:46.829101+0000","last_fullsized":"2022-09-17T10:27:46.829101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831132+0000","last_change":"2022-09-17T10:27:42.816319+0000","last_active":"2022-09-17T10:27:46.831132+0000","last_peered":"2022-09-17T10:27:46.831132+0000","last_clean":"2022-09-17T10:27:46.831132+0000","last_became_active":"2022-09-17T10:27:42.815852+0000","last_became_peered":"2022-09-17T10:27:42.815852+0000","last_unstale":"2022-09-17T10:27:46.831132+0000","last_undegraded":"2022-09-17T10:27:46.831132+0000","last_fullsized":"2022-09-17T10:27:46.831132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838936+0000","last_change":"2022-09-17T10:27:46.834933+0000","last_active":"2022-09-17T10:27:46.838936+0000","last_peered":"2022-09-17T10:27:46.838936+0000","last_clean":"2022-09-17T10:27:46.838936+0000","last_became_active":"2022-09-17T10:27:46.834522+0000","last_became_peered":"2022-09-17T10:27:46.834522+0000","last_unstale":"2022-09-17T10:27:46.838936+0000","last_undegraded":"2022-09-17T10:27:46.838936+0000","last_fullsized":"2022-09-17T10:27:46.838936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823794+0000","last_change":"2022-09-17T10:27:42.421873+0000","last_active":"2022-09-17T10:27:46.823794+0000","last_peered":"2022-09-17T10:27:46.823794+0000","last_clean":"2022-09-17T10:27:46.823794+0000","last_became_active":"2022-09-17T10:27:42.421587+0000","last_became_peered":"2022-09-17T10:27:42.421587+0000","last_unstale":"2022-09-17T10:27:46.823794+0000","last_undegraded":"2022-09-17T10:27:46.823794+0000","last_fullsized":"2022-09-17T10:27:46.823794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823867+0000","last_change":"2022-09-17T10:27:42.805008+0000","last_active":"2022-09-17T10:27:46.823867+0000","last_peered":"2022-09-17T10:27:46.823867+0000","last_clean":"2022-09-17T10:27:46.823867+0000","last_became_active":"2022-09-17T10:27:42.804736+0000","last_became_peered":"2022-09-17T10:27:42.804736+0000","last_unstale":"2022-09-17T10:27:46.823867+0000","last_undegraded":"2022-09-17T10:27:46.823867+0000","last_fullsized":"2022-09-17T10:27:46.823867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.840417+0000","last_change":"2022-09-17T10:27:46.839700+0000","last_active":"2022-09-17T10:27:46.840417+0000","last_peered":"2022-09-17T10:27:46.840417+0000","last_clean":"2022-09-17T10:27:46.840417+0000","last_became_active":"2022-09-17T10:27:46.839222+0000","last_became_peered":"2022-09-17T10:27:46.839222+0000","last_unstale":"2022-09-17T10:27:46.840417+0000","last_undegraded":"2022-09-17T10:27:46.840417+0000","last_fullsized":"2022-09-17T10:27:46.840417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.837453+0000","last_change":"2022-09-17T10:27:46.835973+0000","last_active":"2022-09-17T10:27:46.837453+0000","last_peered":"2022-09-17T10:27:46.837453+0000","last_clean":"2022-09-17T10:27:46.837453+0000","last_became_active":"2022-09-17T10:27:46.835370+0000","last_became_peered":"2022-09-17T10:27:46.835370+0000","last_unstale":"2022-09-17T10:27:46.837453+0000","last_undegraded":"2022-09-17T10:27:46.837453+0000","last_fullsized":"2022-09-17T10:27:46.837453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830729+0000","last_change":"2022-09-17T10:27:42.424396+0000","last_active":"2022-09-17T10:27:46.830729+0000","last_peered":"2022-09-17T10:27:46.830729+0000","last_clean":"2022-09-17T10:27:46.830729+0000","last_became_active":"2022-09-17T10:27:42.424106+0000","last_became_peered":"2022-09-17T10:27:42.424106+0000","last_unstale":"2022-09-17T10:27:46.830729+0000","last_undegraded":"2022-09-17T10:27:46.830729+0000","last_fullsized":"2022-09-17T10:27:46.830729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822522+0000","last_change":"2022-09-17T10:27:42.813371+0000","last_active":"2022-09-17T10:27:46.822522+0000","last_peered":"2022-09-17T10:27:46.822522+0000","last_clean":"2022-09-17T10:27:46.822522+0000","last_became_active":"2022-09-17T10:27:42.813093+0000","last_became_peered":"2022-09-17T10:27:42.813093+0000","last_unstale":"2022-09-17T10:27:46.822522+0000","last_undegraded":"2022-09-17T10:27:46.822522+0000","last_fullsized":"2022-09-17T10:27:46.822522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838300+0000","last_change":"2022-09-17T10:27:46.836367+0000","last_active":"2022-09-17T10:27:46.838300+0000","last_peered":"2022-09-17T10:27:46.838300+0000","last_clean":"2022-09-17T10:27:46.838300+0000","last_became_active":"2022-09-17T10:27:46.835670+0000","last_became_peered":"2022-09-17T10:27:46.835670+0000","last_unstale":"2022-09-17T10:27:46.838300+0000","last_undegraded":"2022-09-17T10:27:46.838300+0000","last_fullsized":"2022-09-17T10:27:46.838300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823937+0000","last_change":"2022-09-17T10:27:42.425999+0000","last_active":"2022-09-17T10:27:46.823937+0000","last_peered":"2022-09-17T10:27:46.823937+0000","last_clean":"2022-09-17T10:27:46.823937+0000","last_became_active":"2022-09-17T10:27:42.425650+0000","last_became_peered":"2022-09-17T10:27:42.425650+0000","last_unstale":"2022-09-17T10:27:46.823937+0000","last_undegraded":"2022-09-17T10:27:46.823937+0000","last_fullsized":"2022-09-17T10:27:46.823937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823053+0000","last_change":"2022-09-17T10:27:42.807915+0000","last_active":"2022-09-17T10:27:46.823053+0000","last_peered":"2022-09-17T10:27:46.823053+0000","last_clean":"2022-09-17T10:27:46.823053+0000","last_became_active":"2022-09-17T10:27:42.807621+0000","last_became_peered":"2022-09-17T10:27:42.807621+0000","last_unstale":"2022-09-17T10:27:46.823053+0000","last_undegraded":"2022-09-17T10:27:46.823053+0000","last_fullsized":"2022-09-17T10:27:46.823053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832588+0000","last_change":"2022-09-17T10:27:42.418946+0000","last_active":"2022-09-17T10:27:46.832588+0000","last_peered":"2022-09-17T10:27:46.832588+0000","last_clean":"2022-09-17T10:27:46.832588+0000","last_became_active":"2022-09-17T10:27:42.418576+0000","last_became_peered":"2022-09-17T10:27:42.418576+0000","last_unstale":"2022-09-17T10:27:46.832588+0000","last_undegraded":"2022-09-17T10:27:46.832588+0000","last_fullsized":"2022-09-17T10:27:46.832588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824054+0000","last_change":"2022-09-17T10:27:42.817091+0000","last_active":"2022-09-17T10:27:46.824054+0000","last_peered":"2022-09-17T10:27:46.824054+0000","last_clean":"2022-09-17T10:27:46.824054+0000","last_became_active":"2022-09-17T10:27:42.816783+0000","last_became_peered":"2022-09-17T10:27:42.816783+0000","last_unstale":"2022-09-17T10:27:46.824054+0000","last_undegraded":"2022-09-17T10:27:46.824054+0000","last_fullsized":"2022-09-17T10:27:46.824054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879369+0000","last_change":"2022-09-17T10:27:46.878071+0000","last_active":"2022-09-17T10:27:46.879369+0000","last_peered":"2022-09-17T10:27:46.879369+0000","last_clean":"2022-09-17T10:27:46.879369+0000","last_became_active":"2022-09-17T10:27:46.877621+0000","last_became_peered":"2022-09-17T10:27:46.877621+0000","last_unstale":"2022-09-17T10:27:46.879369+0000","last_undegraded":"2022-09-17T10:27:46.879369+0000","last_fullsized":"2022-09-17T10:27:46.879369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":161829,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":164234,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":8,"up_from":17,"seq":73014444039,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":161897,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":161219,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":6,"up_from":17,"seq":73014444038,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":162361,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444039,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":161233,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":161233,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":4,"up_from":17,"seq":73014444040,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5392,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366448,"statfs":{"total":96636764160,"available":96631242752,"internally_reserved":0,"allocated":335872,"data_stored":164268,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-09-17T10:28:01.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-09-17T10:28:01.162 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.160+0000 7f818e142700 1 Processor -- start 2022-09-17T10:28:01.162 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.160+0000 7f818e142700 1 -- start start 2022-09-17T10:28:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f818e142700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f81881751b0 0x7f8188180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f818e142700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8188175590 0x7f8188180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f818e142700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81880c6dd0 con 0x7f8188181050 2022-09-17T10:28:01.170 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f818e142700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880f10e0 con 0x7f8188175590 2022-09-17T10:28:01.170 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f818e142700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880f0660 con 0x7f81881751b0 2022-09-17T10:28:01.170 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f8186ffd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8188175590 0x7f8188180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f81877fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f81881751b0 0x7f8188180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f8187fff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8188181050 0x7f8188181dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.62:43104/0 (socket says 172.21.15.62:43104) 2022-09-17T10:28:01.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f8186ffd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8188175590 0x7f8188180b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.62:51742/0 (socket says 172.21.15.62:51742) 2022-09-17T10:28:01.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f8187fff700 1 -- 172.21.15.62:0/343970722 learned_addr learned my addr 172.21.15.62:0/343970722 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f81877fe700 1 -- 172.21.15.62:0/343970722 >> v2:172.21.15.93:3300/0 conn(0x7f8188175590 msgr2=0x7f8188180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f81877fe700 1 --2- 172.21.15.62:0/343970722 >> v2:172.21.15.93:3300/0 conn(0x7f8188175590 0x7f8188180b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f81877fe700 1 -- 172.21.15.62:0/343970722 >> v1:172.21.15.93:6789/0 conn(0x7f8188181050 legacy=0x7f8188181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.161+0000 7f81877fe700 1 -- 172.21.15.62:0/343970722 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81881801e0 con 0x7f81881751b0 2022-09-17T10:28:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f81877fe700 1 --2- 172.21.15.62:0/343970722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81881751b0 0x7f8188180670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f8188088880 tx=0x7f8178009060).ready entity=mon.2 client_cookie=aaa596810fe44085 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:01.173 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f81867fc700 1 -- 172.21.15.62:0/343970722 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780090d0 con 0x7f81881751b0 2022-09-17T10:28:01.173 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f81867fc700 1 -- 172.21.15.62:0/343970722 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817800f510 con 0x7f81881751b0 2022-09-17T10:28:01.173 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f81867fc700 1 -- 172.21.15.62:0/343970722 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817800f890 con 0x7f81881751b0 2022-09-17T10:28:01.173 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f818e142700 1 -- 172.21.15.62:0/343970722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81881751b0 msgr2=0x7f8188180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f818e142700 1 --2- 172.21.15.62:0/343970722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81881751b0 0x7f8188180670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f8188088880 tx=0x7f8178009060).stop 2022-09-17T10:28:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f818e142700 1 -- 172.21.15.62:0/343970722 shutdown_connections 2022-09-17T10:28:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f818e142700 1 --2- 172.21.15.62:0/343970722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81881751b0 0x7f8188180670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f818e142700 1 --2- 172.21.15.62:0/343970722 >> v2:172.21.15.93:3300/0 conn(0x7f8188175590 0x7f8188180b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f818e142700 1 -- 172.21.15.62:0/343970722 >> 172.21.15.62:0/343970722 conn(0x7f818806a170 msgr2=0x7f81880f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f818e142700 1 -- 172.21.15.62:0/343970722 shutdown_connections 2022-09-17T10:28:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.162+0000 7f818e142700 1 -- 172.21.15.62:0/343970722 wait complete. 2022-09-17T10:28:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.164+0000 7f818e142700 1 Processor -- start 2022-09-17T10:28:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.164+0000 7f818e142700 1 -- start start 2022-09-17T10:28:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f818e142700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81881751b0 0x7f81880c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f818e142700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8188175590 0x7f818816def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f818e142700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8188181050 0x7f8188085b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f818e142700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880c7990 con 0x7f81881751b0 2022-09-17T10:28:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f818e142700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880c7c70 con 0x7f8188175590 2022-09-17T10:28:01.178 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f818e142700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880c7f50 con 0x7f8188181050 2022-09-17T10:28:01.178 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81881751b0 0x7f81880c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.178 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81881751b0 0x7f81880c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42858/0 (socket says 172.21.15.62:42858) 2022-09-17T10:28:01.178 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 -- 172.21.15.62:0/1670403031 learned_addr learned my addr 172.21.15.62:0/1670403031 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:01.179 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f8186ffd700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8188175590 0x7f818816def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.179 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f8187fff700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8188181050 0x7f8188085b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.179 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 -- 172.21.15.62:0/1670403031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8188181050 msgr2=0x7f8188085b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.179 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8188181050 0x7f8188085b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 -- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8188175590 msgr2=0x7f818816def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8188175590 0x7f818816def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 -- 172.21.15.62:0/1670403031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780092a0 con 0x7f81881751b0 2022-09-17T10:28:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f8186ffd700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8188175590 0x7f818816def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:01.180 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.165+0000 7f81877fe700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81881751b0 0x7f81880c71c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f8178009dd0 tx=0x7f8178017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:01.181 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.166+0000 7f816f7fe700 1 -- 172.21.15.62:0/1670403031 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178006950 con 0x7f81881751b0 2022-09-17T10:28:01.181 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.166+0000 7f816f7fe700 1 -- 172.21.15.62:0/1670403031 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817800f680 con 0x7f81881751b0 2022-09-17T10:28:01.182 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.166+0000 7f816f7fe700 1 -- 172.21.15.62:0/1670403031 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817801b410 con 0x7f81881751b0 2022-09-17T10:28:01.182 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.166+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81880c8230 con 0x7f81881751b0 2022-09-17T10:28:01.182 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.166+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81880c76b0 con 0x7f81881751b0 2022-09-17T10:28:01.182 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.166+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81880858b0 con 0x7f81881751b0 2022-09-17T10:28:01.185 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.167+0000 7f816f7fe700 1 -- 172.21.15.62:0/1670403031 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f817802b070 con 0x7f81881751b0 2022-09-17T10:28:01.185 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.168+0000 7f816f7fe700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f816808ba40 0x7f816808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.186 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.168+0000 7f816f7fe700 1 -- 172.21.15.62:0/1670403031 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f81780b2110 con 0x7f81881751b0 2022-09-17T10:28:01.186 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.168+0000 7f8186ffd700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f816808ba40 0x7f816808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.186 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.169+0000 7f8186ffd700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f816808ba40 0x7f816808df00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f817c006d80 tx=0x7f817c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:01.187 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.172+0000 7f816f7fe700 1 -- 172.21.15.62:0/1670403031 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f81880858b0 con 0x7f81881751b0 2022-09-17T10:28:01.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.342+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 --> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81880858b0 con 0x7f816808ba40 2022-09-17T10:28:01.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.355+0000 7f816f7fe700 1 -- 172.21.15.62:0/1670403031 <== mgr.4114 v2:172.21.15.93:6832/81423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434602 (secure 0 0 0) 0x7f81880858b0 con 0x7f816808ba40 2022-09-17T10:28:01.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:01.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.358+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f816808ba40 msgr2=0x7f816808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.358+0000 7f818e142700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f816808ba40 0x7f816808df00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f817c006d80 tx=0x7f817c008040).stop 2022-09-17T10:28:01.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.358+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81881751b0 msgr2=0x7f81880c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.358+0000 7f818e142700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81881751b0 0x7f81880c71c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f8178009dd0 tx=0x7f8178017000).stop 2022-09-17T10:28:01.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.359+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 shutdown_connections 2022-09-17T10:28:01.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.359+0000 7f818e142700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f816808ba40 0x7f816808df00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.359+0000 7f818e142700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8188181050 0x7f8188085b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.359+0000 7f818e142700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81881751b0 0x7f81880c71c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.359+0000 7f818e142700 1 --2- 172.21.15.62:0/1670403031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8188175590 0x7f818816def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.359+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 >> 172.21.15.62:0/1670403031 conn(0x7f818806a170 msgr2=0x7f8188063b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.359+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 shutdown_connections 2022-09-17T10:28:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.359+0000 7f818e142700 1 -- 172.21.15.62:0/1670403031 wait complete. 2022-09-17T10:28:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2022-09-17T10:28:01.382 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2022-09-17T10:28:00.881064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":63968,"kb_used_data":3904,"kb_used_omap":0,"kb_used_meta":59968,"kb_avail":1132398112,"statfs":{"total":1159641169920,"available":1159575666688,"internally_reserved":0,"allocated":3997696,"data_stored":1942926,"data_compressed":133308,"data_compressed_allocated":196608,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":61407232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003760"},"pg_stats":[{"pgid":"3.3f","version":"26'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822243+0000","last_change":"2022-09-17T10:27:42.422299+0000","last_active":"2022-09-17T10:27:46.822243+0000","last_peered":"2022-09-17T10:27:46.822243+0000","last_clean":"2022-09-17T10:27:46.822243+0000","last_became_active":"2022-09-17T10:27:42.421964+0000","last_became_peered":"2022-09-17T10:27:42.421964+0000","last_unstale":"2022-09-17T10:27:46.822243+0000","last_undegraded":"2022-09-17T10:27:46.822243+0000","last_fullsized":"2022-09-17T10:27:46.822243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826597+0000","last_change":"2022-09-17T10:27:42.817398+0000","last_active":"2022-09-17T10:27:46.826597+0000","last_peered":"2022-09-17T10:27:46.826597+0000","last_clean":"2022-09-17T10:27:46.826597+0000","last_became_active":"2022-09-17T10:27:42.816997+0000","last_became_peered":"2022-09-17T10:27:42.816997+0000","last_unstale":"2022-09-17T10:27:46.826597+0000","last_undegraded":"2022-09-17T10:27:46.826597+0000","last_fullsized":"2022-09-17T10:27:46.826597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823263+0000","last_change":"2022-09-17T10:27:42.420800+0000","last_active":"2022-09-17T10:27:46.823263+0000","last_peered":"2022-09-17T10:27:46.823263+0000","last_clean":"2022-09-17T10:27:46.823263+0000","last_became_active":"2022-09-17T10:27:42.420493+0000","last_became_peered":"2022-09-17T10:27:42.420493+0000","last_unstale":"2022-09-17T10:27:46.823263+0000","last_undegraded":"2022-09-17T10:27:46.823263+0000","last_fullsized":"2022-09-17T10:27:46.823263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828146+0000","last_change":"2022-09-17T10:27:42.813032+0000","last_active":"2022-09-17T10:27:46.828146+0000","last_peered":"2022-09-17T10:27:46.828146+0000","last_clean":"2022-09-17T10:27:46.828146+0000","last_became_active":"2022-09-17T10:27:42.812613+0000","last_became_peered":"2022-09-17T10:27:42.812613+0000","last_unstale":"2022-09-17T10:27:46.828146+0000","last_undegraded":"2022-09-17T10:27:46.828146+0000","last_fullsized":"2022-09-17T10:27:46.828146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823043+0000","last_change":"2022-09-17T10:27:42.419699+0000","last_active":"2022-09-17T10:27:46.823043+0000","last_peered":"2022-09-17T10:27:46.823043+0000","last_clean":"2022-09-17T10:27:46.823043+0000","last_became_active":"2022-09-17T10:27:42.419381+0000","last_became_peered":"2022-09-17T10:27:42.419381+0000","last_unstale":"2022-09-17T10:27:46.823043+0000","last_undegraded":"2022-09-17T10:27:46.823043+0000","last_fullsized":"2022-09-17T10:27:46.823043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821000+0000","last_change":"2022-09-17T10:27:42.812216+0000","last_active":"2022-09-17T10:27:46.821000+0000","last_peered":"2022-09-17T10:27:46.821000+0000","last_clean":"2022-09-17T10:27:46.821000+0000","last_became_active":"2022-09-17T10:27:42.811495+0000","last_became_peered":"2022-09-17T10:27:42.811495+0000","last_unstale":"2022-09-17T10:27:46.821000+0000","last_undegraded":"2022-09-17T10:27:46.821000+0000","last_fullsized":"2022-09-17T10:27:46.821000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821860+0000","last_change":"2022-09-17T10:27:42.423214+0000","last_active":"2022-09-17T10:27:46.821860+0000","last_peered":"2022-09-17T10:27:46.821860+0000","last_clean":"2022-09-17T10:27:46.821860+0000","last_became_active":"2022-09-17T10:27:42.422645+0000","last_became_peered":"2022-09-17T10:27:42.422645+0000","last_unstale":"2022-09-17T10:27:46.821860+0000","last_undegraded":"2022-09-17T10:27:46.821860+0000","last_fullsized":"2022-09-17T10:27:46.821860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821942+0000","last_change":"2022-09-17T10:27:42.816222+0000","last_active":"2022-09-17T10:27:46.821942+0000","last_peered":"2022-09-17T10:27:46.821942+0000","last_clean":"2022-09-17T10:27:46.821942+0000","last_became_active":"2022-09-17T10:27:42.815835+0000","last_became_peered":"2022-09-17T10:27:42.815835+0000","last_unstale":"2022-09-17T10:27:46.821942+0000","last_undegraded":"2022-09-17T10:27:46.821942+0000","last_fullsized":"2022-09-17T10:27:46.821942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.833135+0000","last_change":"2022-09-17T10:27:42.422984+0000","last_active":"2022-09-17T10:27:46.833135+0000","last_peered":"2022-09-17T10:27:46.833135+0000","last_clean":"2022-09-17T10:27:46.833135+0000","last_became_active":"2022-09-17T10:27:42.422710+0000","last_became_peered":"2022-09-17T10:27:42.422710+0000","last_unstale":"2022-09-17T10:27:46.833135+0000","last_undegraded":"2022-09-17T10:27:46.833135+0000","last_fullsized":"2022-09-17T10:27:46.833135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828197+0000","last_change":"2022-09-17T10:27:42.812970+0000","last_active":"2022-09-17T10:27:46.828197+0000","last_peered":"2022-09-17T10:27:46.828197+0000","last_clean":"2022-09-17T10:27:46.828197+0000","last_became_active":"2022-09-17T10:27:42.812675+0000","last_became_peered":"2022-09-17T10:27:42.812675+0000","last_unstale":"2022-09-17T10:27:46.828197+0000","last_undegraded":"2022-09-17T10:27:46.828197+0000","last_fullsized":"2022-09-17T10:27:46.828197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824416+0000","last_change":"2022-09-17T10:27:42.417757+0000","last_active":"2022-09-17T10:27:46.824416+0000","last_peered":"2022-09-17T10:27:46.824416+0000","last_clean":"2022-09-17T10:27:46.824416+0000","last_became_active":"2022-09-17T10:27:42.417425+0000","last_became_peered":"2022-09-17T10:27:42.417425+0000","last_unstale":"2022-09-17T10:27:46.824416+0000","last_undegraded":"2022-09-17T10:27:46.824416+0000","last_fullsized":"2022-09-17T10:27:46.824416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821143+0000","last_change":"2022-09-17T10:27:42.815053+0000","last_active":"2022-09-17T10:27:46.821143+0000","last_peered":"2022-09-17T10:27:46.821143+0000","last_clean":"2022-09-17T10:27:46.821143+0000","last_became_active":"2022-09-17T10:27:42.814772+0000","last_became_peered":"2022-09-17T10:27:42.814772+0000","last_unstale":"2022-09-17T10:27:46.821143+0000","last_undegraded":"2022-09-17T10:27:46.821143+0000","last_fullsized":"2022-09-17T10:27:46.821143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831182+0000","last_change":"2022-09-17T10:27:42.420271+0000","last_active":"2022-09-17T10:27:46.831182+0000","last_peered":"2022-09-17T10:27:46.831182+0000","last_clean":"2022-09-17T10:27:46.831182+0000","last_became_active":"2022-09-17T10:27:42.419991+0000","last_became_peered":"2022-09-17T10:27:42.419991+0000","last_unstale":"2022-09-17T10:27:46.831182+0000","last_undegraded":"2022-09-17T10:27:46.831182+0000","last_fullsized":"2022-09-17T10:27:46.831182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823843+0000","last_change":"2022-09-17T10:27:42.806227+0000","last_active":"2022-09-17T10:27:46.823843+0000","last_peered":"2022-09-17T10:27:46.823843+0000","last_clean":"2022-09-17T10:27:46.823843+0000","last_became_active":"2022-09-17T10:27:42.805882+0000","last_became_peered":"2022-09-17T10:27:42.805882+0000","last_unstale":"2022-09-17T10:27:46.823843+0000","last_undegraded":"2022-09-17T10:27:46.823843+0000","last_fullsized":"2022-09-17T10:27:46.823843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830859+0000","last_change":"2022-09-17T10:27:42.423044+0000","last_active":"2022-09-17T10:27:46.830859+0000","last_peered":"2022-09-17T10:27:46.830859+0000","last_clean":"2022-09-17T10:27:46.830859+0000","last_became_active":"2022-09-17T10:27:42.421055+0000","last_became_peered":"2022-09-17T10:27:42.421055+0000","last_unstale":"2022-09-17T10:27:46.830859+0000","last_undegraded":"2022-09-17T10:27:46.830859+0000","last_fullsized":"2022-09-17T10:27:46.830859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823833+0000","last_change":"2022-09-17T10:27:42.807118+0000","last_active":"2022-09-17T10:27:46.823833+0000","last_peered":"2022-09-17T10:27:46.823833+0000","last_clean":"2022-09-17T10:27:46.823833+0000","last_became_active":"2022-09-17T10:27:42.806225+0000","last_became_peered":"2022-09-17T10:27:42.806225+0000","last_unstale":"2022-09-17T10:27:46.823833+0000","last_undegraded":"2022-09-17T10:27:46.823833+0000","last_fullsized":"2022-09-17T10:27:46.823833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828853+0000","last_change":"2022-09-17T10:27:42.412247+0000","last_active":"2022-09-17T10:27:46.828853+0000","last_peered":"2022-09-17T10:27:46.828853+0000","last_clean":"2022-09-17T10:27:46.828853+0000","last_became_active":"2022-09-17T10:27:42.411939+0000","last_became_peered":"2022-09-17T10:27:42.411939+0000","last_unstale":"2022-09-17T10:27:46.828853+0000","last_undegraded":"2022-09-17T10:27:46.828853+0000","last_fullsized":"2022-09-17T10:27:46.828853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821076+0000","last_change":"2022-09-17T10:27:42.813817+0000","last_active":"2022-09-17T10:27:46.821076+0000","last_peered":"2022-09-17T10:27:46.821076+0000","last_clean":"2022-09-17T10:27:46.821076+0000","last_became_active":"2022-09-17T10:27:42.811044+0000","last_became_peered":"2022-09-17T10:27:42.811044+0000","last_unstale":"2022-09-17T10:27:46.821076+0000","last_undegraded":"2022-09-17T10:27:46.821076+0000","last_fullsized":"2022-09-17T10:27:46.821076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824466+0000","last_change":"2022-09-17T10:27:42.424111+0000","last_active":"2022-09-17T10:27:46.824466+0000","last_peered":"2022-09-17T10:27:46.824466+0000","last_clean":"2022-09-17T10:27:46.824466+0000","last_became_active":"2022-09-17T10:27:42.423848+0000","last_became_peered":"2022-09-17T10:27:42.423848+0000","last_unstale":"2022-09-17T10:27:46.824466+0000","last_undegraded":"2022-09-17T10:27:46.824466+0000","last_fullsized":"2022-09-17T10:27:46.824466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826305+0000","last_change":"2022-09-17T10:27:42.812631+0000","last_active":"2022-09-17T10:27:46.826305+0000","last_peered":"2022-09-17T10:27:46.826305+0000","last_clean":"2022-09-17T10:27:46.826305+0000","last_became_active":"2022-09-17T10:27:42.812131+0000","last_became_peered":"2022-09-17T10:27:42.812131+0000","last_unstale":"2022-09-17T10:27:46.826305+0000","last_undegraded":"2022-09-17T10:27:46.826305+0000","last_fullsized":"2022-09-17T10:27:46.826305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828342+0000","last_change":"2022-09-17T10:27:42.423717+0000","last_active":"2022-09-17T10:27:46.828342+0000","last_peered":"2022-09-17T10:27:46.828342+0000","last_clean":"2022-09-17T10:27:46.828342+0000","last_became_active":"2022-09-17T10:27:42.423419+0000","last_became_peered":"2022-09-17T10:27:42.423419+0000","last_unstale":"2022-09-17T10:27:46.828342+0000","last_undegraded":"2022-09-17T10:27:46.828342+0000","last_fullsized":"2022-09-17T10:27:46.828342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826766+0000","last_change":"2022-09-17T10:27:42.815134+0000","last_active":"2022-09-17T10:27:46.826766+0000","last_peered":"2022-09-17T10:27:46.826766+0000","last_clean":"2022-09-17T10:27:46.826766+0000","last_became_active":"2022-09-17T10:27:42.814787+0000","last_became_peered":"2022-09-17T10:27:42.814787+0000","last_unstale":"2022-09-17T10:27:46.826766+0000","last_undegraded":"2022-09-17T10:27:46.826766+0000","last_fullsized":"2022-09-17T10:27:46.826766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'7","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:55.773333+0000","last_change":"2022-09-17T10:27:42.420222+0000","last_active":"2022-09-17T10:27:55.773333+0000","last_peered":"2022-09-17T10:27:55.773333+0000","last_clean":"2022-09-17T10:27:55.773333+0000","last_became_active":"2022-09-17T10:27:42.419931+0000","last_became_peered":"2022-09-17T10:27:42.419931+0000","last_unstale":"2022-09-17T10:27:55.773333+0000","last_undegraded":"2022-09-17T10:27:55.773333+0000","last_fullsized":"2022-09-17T10:27:55.773333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3071,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828436+0000","last_change":"2022-09-17T10:27:42.819910+0000","last_active":"2022-09-17T10:27:46.828436+0000","last_peered":"2022-09-17T10:27:46.828436+0000","last_clean":"2022-09-17T10:27:46.828436+0000","last_became_active":"2022-09-17T10:27:42.819746+0000","last_became_peered":"2022-09-17T10:27:42.819746+0000","last_unstale":"2022-09-17T10:27:46.828436+0000","last_undegraded":"2022-09-17T10:27:46.828436+0000","last_fullsized":"2022-09-17T10:27:46.828436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877176+0000","last_change":"2022-09-17T10:27:42.415809+0000","last_active":"2022-09-17T10:27:46.877176+0000","last_peered":"2022-09-17T10:27:46.877176+0000","last_clean":"2022-09-17T10:27:46.877176+0000","last_became_active":"2022-09-17T10:27:42.415484+0000","last_became_peered":"2022-09-17T10:27:42.415484+0000","last_unstale":"2022-09-17T10:27:46.877176+0000","last_undegraded":"2022-09-17T10:27:46.877176+0000","last_fullsized":"2022-09-17T10:27:46.877176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823651+0000","last_change":"2022-09-17T10:27:42.807756+0000","last_active":"2022-09-17T10:27:46.823651+0000","last_peered":"2022-09-17T10:27:46.823651+0000","last_clean":"2022-09-17T10:27:46.823651+0000","last_became_active":"2022-09-17T10:27:42.805782+0000","last_became_peered":"2022-09-17T10:27:42.805782+0000","last_unstale":"2022-09-17T10:27:46.823651+0000","last_undegraded":"2022-09-17T10:27:46.823651+0000","last_fullsized":"2022-09-17T10:27:46.823651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823055+0000","last_change":"2022-09-17T10:27:42.422195+0000","last_active":"2022-09-17T10:27:46.823055+0000","last_peered":"2022-09-17T10:27:46.823055+0000","last_clean":"2022-09-17T10:27:46.823055+0000","last_became_active":"2022-09-17T10:27:42.421922+0000","last_became_peered":"2022-09-17T10:27:42.421922+0000","last_unstale":"2022-09-17T10:27:46.823055+0000","last_undegraded":"2022-09-17T10:27:46.823055+0000","last_fullsized":"2022-09-17T10:27:46.823055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821862+0000","last_change":"2022-09-17T10:27:42.813050+0000","last_active":"2022-09-17T10:27:46.821862+0000","last_peered":"2022-09-17T10:27:46.821862+0000","last_clean":"2022-09-17T10:27:46.821862+0000","last_became_active":"2022-09-17T10:27:42.812770+0000","last_became_peered":"2022-09-17T10:27:42.812770+0000","last_unstale":"2022-09-17T10:27:46.821862+0000","last_undegraded":"2022-09-17T10:27:46.821862+0000","last_fullsized":"2022-09-17T10:27:46.821862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822857+0000","last_change":"2022-09-17T10:27:42.422344+0000","last_active":"2022-09-17T10:27:46.822857+0000","last_peered":"2022-09-17T10:27:46.822857+0000","last_clean":"2022-09-17T10:27:46.822857+0000","last_became_active":"2022-09-17T10:27:42.422015+0000","last_became_peered":"2022-09-17T10:27:42.422015+0000","last_unstale":"2022-09-17T10:27:46.822857+0000","last_undegraded":"2022-09-17T10:27:46.822857+0000","last_fullsized":"2022-09-17T10:27:46.822857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822890+0000","last_change":"2022-09-17T10:27:42.814260+0000","last_active":"2022-09-17T10:27:46.822890+0000","last_peered":"2022-09-17T10:27:46.822890+0000","last_clean":"2022-09-17T10:27:46.822890+0000","last_became_active":"2022-09-17T10:27:42.812936+0000","last_became_peered":"2022-09-17T10:27:42.812936+0000","last_unstale":"2022-09-17T10:27:46.822890+0000","last_undegraded":"2022-09-17T10:27:46.822890+0000","last_fullsized":"2022-09-17T10:27:46.822890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"26'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826690+0000","last_change":"2022-09-17T10:27:42.417825+0000","last_active":"2022-09-17T10:27:46.826690+0000","last_peered":"2022-09-17T10:27:46.826690+0000","last_clean":"2022-09-17T10:27:46.826690+0000","last_became_active":"2022-09-17T10:27:42.417512+0000","last_became_peered":"2022-09-17T10:27:42.417512+0000","last_unstale":"2022-09-17T10:27:46.826690+0000","last_undegraded":"2022-09-17T10:27:46.826690+0000","last_fullsized":"2022-09-17T10:27:46.826690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823543+0000","last_change":"2022-09-17T10:27:42.807539+0000","last_active":"2022-09-17T10:27:46.823543+0000","last_peered":"2022-09-17T10:27:46.823543+0000","last_clean":"2022-09-17T10:27:46.823543+0000","last_became_active":"2022-09-17T10:27:42.807279+0000","last_became_peered":"2022-09-17T10:27:42.807279+0000","last_unstale":"2022-09-17T10:27:46.823543+0000","last_undegraded":"2022-09-17T10:27:46.823543+0000","last_fullsized":"2022-09-17T10:27:46.823543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822418+0000","last_change":"2022-09-17T10:27:42.422307+0000","last_active":"2022-09-17T10:27:46.822418+0000","last_peered":"2022-09-17T10:27:46.822418+0000","last_clean":"2022-09-17T10:27:46.822418+0000","last_became_active":"2022-09-17T10:27:42.421975+0000","last_became_peered":"2022-09-17T10:27:42.421975+0000","last_unstale":"2022-09-17T10:27:46.822418+0000","last_undegraded":"2022-09-17T10:27:46.822418+0000","last_fullsized":"2022-09-17T10:27:46.822418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821707+0000","last_change":"2022-09-17T10:27:42.810271+0000","last_active":"2022-09-17T10:27:46.821707+0000","last_peered":"2022-09-17T10:27:46.821707+0000","last_clean":"2022-09-17T10:27:46.821707+0000","last_became_active":"2022-09-17T10:27:42.809991+0000","last_became_peered":"2022-09-17T10:27:42.809991+0000","last_unstale":"2022-09-17T10:27:46.821707+0000","last_undegraded":"2022-09-17T10:27:46.821707+0000","last_fullsized":"2022-09-17T10:27:46.821707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823546+0000","last_change":"2022-09-17T10:27:42.414343+0000","last_active":"2022-09-17T10:27:46.823546+0000","last_peered":"2022-09-17T10:27:46.823546+0000","last_clean":"2022-09-17T10:27:46.823546+0000","last_became_active":"2022-09-17T10:27:42.413935+0000","last_became_peered":"2022-09-17T10:27:42.413935+0000","last_unstale":"2022-09-17T10:27:46.823546+0000","last_undegraded":"2022-09-17T10:27:46.823546+0000","last_fullsized":"2022-09-17T10:27:46.823546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823831+0000","last_change":"2022-09-17T10:27:42.804945+0000","last_active":"2022-09-17T10:27:46.823831+0000","last_peered":"2022-09-17T10:27:46.823831+0000","last_clean":"2022-09-17T10:27:46.823831+0000","last_became_active":"2022-09-17T10:27:42.804661+0000","last_became_peered":"2022-09-17T10:27:42.804661+0000","last_unstale":"2022-09-17T10:27:46.823831+0000","last_undegraded":"2022-09-17T10:27:46.823831+0000","last_fullsized":"2022-09-17T10:27:46.823831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824216+0000","last_change":"2022-09-17T10:27:42.423897+0000","last_active":"2022-09-17T10:27:46.824216+0000","last_peered":"2022-09-17T10:27:46.824216+0000","last_clean":"2022-09-17T10:27:46.824216+0000","last_became_active":"2022-09-17T10:27:42.423587+0000","last_became_peered":"2022-09-17T10:27:42.423587+0000","last_unstale":"2022-09-17T10:27:46.824216+0000","last_undegraded":"2022-09-17T10:27:46.824216+0000","last_fullsized":"2022-09-17T10:27:46.824216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821855+0000","last_change":"2022-09-17T10:27:42.814043+0000","last_active":"2022-09-17T10:27:46.821855+0000","last_peered":"2022-09-17T10:27:46.821855+0000","last_clean":"2022-09-17T10:27:46.821855+0000","last_became_active":"2022-09-17T10:27:42.813400+0000","last_became_peered":"2022-09-17T10:27:42.813400+0000","last_unstale":"2022-09-17T10:27:46.821855+0000","last_undegraded":"2022-09-17T10:27:46.821855+0000","last_fullsized":"2022-09-17T10:27:46.821855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821847+0000","last_change":"2022-09-17T10:27:42.420351+0000","last_active":"2022-09-17T10:27:46.821847+0000","last_peered":"2022-09-17T10:27:46.821847+0000","last_clean":"2022-09-17T10:27:46.821847+0000","last_became_active":"2022-09-17T10:27:42.420099+0000","last_became_peered":"2022-09-17T10:27:42.420099+0000","last_unstale":"2022-09-17T10:27:46.821847+0000","last_undegraded":"2022-09-17T10:27:46.821847+0000","last_fullsized":"2022-09-17T10:27:46.821847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823380+0000","last_change":"2022-09-17T10:27:42.809309+0000","last_active":"2022-09-17T10:27:46.823380+0000","last_peered":"2022-09-17T10:27:46.823380+0000","last_clean":"2022-09-17T10:27:46.823380+0000","last_became_active":"2022-09-17T10:27:42.809010+0000","last_became_peered":"2022-09-17T10:27:42.809010+0000","last_unstale":"2022-09-17T10:27:46.823380+0000","last_undegraded":"2022-09-17T10:27:46.823380+0000","last_fullsized":"2022-09-17T10:27:46.823380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877081+0000","last_change":"2022-09-17T10:27:42.420420+0000","last_active":"2022-09-17T10:27:46.877081+0000","last_peered":"2022-09-17T10:27:46.877081+0000","last_clean":"2022-09-17T10:27:46.877081+0000","last_became_active":"2022-09-17T10:27:42.420111+0000","last_became_peered":"2022-09-17T10:27:42.420111+0000","last_unstale":"2022-09-17T10:27:46.877081+0000","last_undegraded":"2022-09-17T10:27:46.877081+0000","last_fullsized":"2022-09-17T10:27:46.877081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828081+0000","last_change":"2022-09-17T10:27:42.813626+0000","last_active":"2022-09-17T10:27:46.828081+0000","last_peered":"2022-09-17T10:27:46.828081+0000","last_clean":"2022-09-17T10:27:46.828081+0000","last_became_active":"2022-09-17T10:27:42.813315+0000","last_became_peered":"2022-09-17T10:27:42.813315+0000","last_unstale":"2022-09-17T10:27:46.828081+0000","last_undegraded":"2022-09-17T10:27:46.828081+0000","last_fullsized":"2022-09-17T10:27:46.828081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828974+0000","last_change":"2022-09-17T10:27:42.418323+0000","last_active":"2022-09-17T10:27:46.828974+0000","last_peered":"2022-09-17T10:27:46.828974+0000","last_clean":"2022-09-17T10:27:46.828974+0000","last_became_active":"2022-09-17T10:27:42.417741+0000","last_became_peered":"2022-09-17T10:27:42.417741+0000","last_unstale":"2022-09-17T10:27:46.828974+0000","last_undegraded":"2022-09-17T10:27:46.828974+0000","last_fullsized":"2022-09-17T10:27:46.828974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877907+0000","last_change":"2022-09-17T10:27:42.815309+0000","last_active":"2022-09-17T10:27:46.877907+0000","last_peered":"2022-09-17T10:27:46.877907+0000","last_clean":"2022-09-17T10:27:46.877907+0000","last_became_active":"2022-09-17T10:27:42.815017+0000","last_became_peered":"2022-09-17T10:27:42.815017+0000","last_unstale":"2022-09-17T10:27:46.877907+0000","last_undegraded":"2022-09-17T10:27:46.877907+0000","last_fullsized":"2022-09-17T10:27:46.877907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831220+0000","last_change":"2022-09-17T10:27:42.426225+0000","last_active":"2022-09-17T10:27:46.831220+0000","last_peered":"2022-09-17T10:27:46.831220+0000","last_clean":"2022-09-17T10:27:46.831220+0000","last_became_active":"2022-09-17T10:27:42.425653+0000","last_became_peered":"2022-09-17T10:27:42.425653+0000","last_unstale":"2022-09-17T10:27:46.831220+0000","last_undegraded":"2022-09-17T10:27:46.831220+0000","last_fullsized":"2022-09-17T10:27:46.831220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823944+0000","last_change":"2022-09-17T10:27:42.811093+0000","last_active":"2022-09-17T10:27:46.823944+0000","last_peered":"2022-09-17T10:27:46.823944+0000","last_clean":"2022-09-17T10:27:46.823944+0000","last_became_active":"2022-09-17T10:27:42.810788+0000","last_became_peered":"2022-09-17T10:27:42.810788+0000","last_unstale":"2022-09-17T10:27:46.823944+0000","last_undegraded":"2022-09-17T10:27:46.823944+0000","last_fullsized":"2022-09-17T10:27:46.823944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826854+0000","last_change":"2022-09-17T10:27:42.418052+0000","last_active":"2022-09-17T10:27:46.826854+0000","last_peered":"2022-09-17T10:27:46.826854+0000","last_clean":"2022-09-17T10:27:46.826854+0000","last_became_active":"2022-09-17T10:27:42.417695+0000","last_became_peered":"2022-09-17T10:27:42.417695+0000","last_unstale":"2022-09-17T10:27:46.826854+0000","last_undegraded":"2022-09-17T10:27:46.826854+0000","last_fullsized":"2022-09-17T10:27:46.826854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823676+0000","last_change":"2022-09-17T10:27:42.816896+0000","last_active":"2022-09-17T10:27:46.823676+0000","last_peered":"2022-09-17T10:27:46.823676+0000","last_clean":"2022-09-17T10:27:46.823676+0000","last_became_active":"2022-09-17T10:27:42.816607+0000","last_became_peered":"2022-09-17T10:27:42.816607+0000","last_unstale":"2022-09-17T10:27:46.823676+0000","last_undegraded":"2022-09-17T10:27:46.823676+0000","last_fullsized":"2022-09-17T10:27:46.823676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831328+0000","last_change":"2022-09-17T10:27:42.421839+0000","last_active":"2022-09-17T10:27:46.831328+0000","last_peered":"2022-09-17T10:27:46.831328+0000","last_clean":"2022-09-17T10:27:46.831328+0000","last_became_active":"2022-09-17T10:27:42.421558+0000","last_became_peered":"2022-09-17T10:27:42.421558+0000","last_unstale":"2022-09-17T10:27:46.831328+0000","last_undegraded":"2022-09-17T10:27:46.831328+0000","last_fullsized":"2022-09-17T10:27:46.831328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822971+0000","last_change":"2022-09-17T10:27:42.812667+0000","last_active":"2022-09-17T10:27:46.822971+0000","last_peered":"2022-09-17T10:27:46.822971+0000","last_clean":"2022-09-17T10:27:46.822971+0000","last_became_active":"2022-09-17T10:27:42.812360+0000","last_became_peered":"2022-09-17T10:27:42.812360+0000","last_unstale":"2022-09-17T10:27:46.822971+0000","last_undegraded":"2022-09-17T10:27:46.822971+0000","last_fullsized":"2022-09-17T10:27:46.822971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.278681+0000","last_change":"2022-09-17T10:27:42.418422+0000","last_active":"2022-09-17T10:27:47.278681+0000","last_peered":"2022-09-17T10:27:47.278681+0000","last_clean":"2022-09-17T10:27:47.278681+0000","last_became_active":"2022-09-17T10:27:42.418158+0000","last_became_peered":"2022-09-17T10:27:42.418158+0000","last_unstale":"2022-09-17T10:27:47.278681+0000","last_undegraded":"2022-09-17T10:27:47.278681+0000","last_fullsized":"2022-09-17T10:27:47.278681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876897+0000","last_change":"2022-09-17T10:27:42.816353+0000","last_active":"2022-09-17T10:27:46.876897+0000","last_peered":"2022-09-17T10:27:46.876897+0000","last_clean":"2022-09-17T10:27:46.876897+0000","last_became_active":"2022-09-17T10:27:42.816143+0000","last_became_peered":"2022-09-17T10:27:42.816143+0000","last_unstale":"2022-09-17T10:27:46.876897+0000","last_undegraded":"2022-09-17T10:27:46.876897+0000","last_fullsized":"2022-09-17T10:27:46.876897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822690+0000","last_change":"2022-09-17T10:27:42.415503+0000","last_active":"2022-09-17T10:27:46.822690+0000","last_peered":"2022-09-17T10:27:46.822690+0000","last_clean":"2022-09-17T10:27:46.822690+0000","last_became_active":"2022-09-17T10:27:42.415203+0000","last_became_peered":"2022-09-17T10:27:42.415203+0000","last_unstale":"2022-09-17T10:27:46.822690+0000","last_undegraded":"2022-09-17T10:27:46.822690+0000","last_fullsized":"2022-09-17T10:27:46.822690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821740+0000","last_change":"2022-09-17T10:27:42.814233+0000","last_active":"2022-09-17T10:27:46.821740+0000","last_peered":"2022-09-17T10:27:46.821740+0000","last_clean":"2022-09-17T10:27:46.821740+0000","last_became_active":"2022-09-17T10:27:42.813735+0000","last_became_peered":"2022-09-17T10:27:42.813735+0000","last_unstale":"2022-09-17T10:27:46.821740+0000","last_undegraded":"2022-09-17T10:27:46.821740+0000","last_fullsized":"2022-09-17T10:27:46.821740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877411+0000","last_change":"2022-09-17T10:27:42.420755+0000","last_active":"2022-09-17T10:27:46.877411+0000","last_peered":"2022-09-17T10:27:46.877411+0000","last_clean":"2022-09-17T10:27:46.877411+0000","last_became_active":"2022-09-17T10:27:42.420413+0000","last_became_peered":"2022-09-17T10:27:42.420413+0000","last_unstale":"2022-09-17T10:27:46.877411+0000","last_undegraded":"2022-09-17T10:27:46.877411+0000","last_fullsized":"2022-09-17T10:27:46.877411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831001+0000","last_change":"2022-09-17T10:27:42.818083+0000","last_active":"2022-09-17T10:27:46.831001+0000","last_peered":"2022-09-17T10:27:46.831001+0000","last_clean":"2022-09-17T10:27:46.831001+0000","last_became_active":"2022-09-17T10:27:42.817877+0000","last_became_peered":"2022-09-17T10:27:42.817877+0000","last_unstale":"2022-09-17T10:27:46.831001+0000","last_undegraded":"2022-09-17T10:27:46.831001+0000","last_fullsized":"2022-09-17T10:27:46.831001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824985+0000","last_change":"2022-09-17T10:27:42.419616+0000","last_active":"2022-09-17T10:27:46.824985+0000","last_peered":"2022-09-17T10:27:46.824985+0000","last_clean":"2022-09-17T10:27:46.824985+0000","last_became_active":"2022-09-17T10:27:42.419310+0000","last_became_peered":"2022-09-17T10:27:42.419310+0000","last_unstale":"2022-09-17T10:27:46.824985+0000","last_undegraded":"2022-09-17T10:27:46.824985+0000","last_fullsized":"2022-09-17T10:27:46.824985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825681+0000","last_change":"2022-09-17T10:27:42.817667+0000","last_active":"2022-09-17T10:27:46.825681+0000","last_peered":"2022-09-17T10:27:46.825681+0000","last_clean":"2022-09-17T10:27:46.825681+0000","last_became_active":"2022-09-17T10:27:42.817320+0000","last_became_peered":"2022-09-17T10:27:42.817320+0000","last_unstale":"2022-09-17T10:27:46.825681+0000","last_undegraded":"2022-09-17T10:27:46.825681+0000","last_fullsized":"2022-09-17T10:27:46.825681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824135+0000","last_change":"2022-09-17T10:27:42.423348+0000","last_active":"2022-09-17T10:27:46.824135+0000","last_peered":"2022-09-17T10:27:46.824135+0000","last_clean":"2022-09-17T10:27:46.824135+0000","last_became_active":"2022-09-17T10:27:42.423040+0000","last_became_peered":"2022-09-17T10:27:42.423040+0000","last_unstale":"2022-09-17T10:27:46.824135+0000","last_undegraded":"2022-09-17T10:27:46.824135+0000","last_fullsized":"2022-09-17T10:27:46.824135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822997+0000","last_change":"2022-09-17T10:27:42.808072+0000","last_active":"2022-09-17T10:27:46.822997+0000","last_peered":"2022-09-17T10:27:46.822997+0000","last_clean":"2022-09-17T10:27:46.822997+0000","last_became_active":"2022-09-17T10:27:42.807765+0000","last_became_peered":"2022-09-17T10:27:42.807765+0000","last_unstale":"2022-09-17T10:27:46.822997+0000","last_undegraded":"2022-09-17T10:27:46.822997+0000","last_fullsized":"2022-09-17T10:27:46.822997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823608+0000","last_change":"2022-09-17T10:27:42.417146+0000","last_active":"2022-09-17T10:27:46.823608+0000","last_peered":"2022-09-17T10:27:46.823608+0000","last_clean":"2022-09-17T10:27:46.823608+0000","last_became_active":"2022-09-17T10:27:42.416444+0000","last_became_peered":"2022-09-17T10:27:42.416444+0000","last_unstale":"2022-09-17T10:27:46.823608+0000","last_undegraded":"2022-09-17T10:27:46.823608+0000","last_fullsized":"2022-09-17T10:27:46.823608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879652+0000","last_change":"2022-09-17T10:27:42.808199+0000","last_active":"2022-09-17T10:27:46.879652+0000","last_peered":"2022-09-17T10:27:46.879652+0000","last_clean":"2022-09-17T10:27:46.879652+0000","last_became_active":"2022-09-17T10:27:42.807904+0000","last_became_peered":"2022-09-17T10:27:42.807904+0000","last_unstale":"2022-09-17T10:27:46.879652+0000","last_undegraded":"2022-09-17T10:27:46.879652+0000","last_fullsized":"2022-09-17T10:27:46.879652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821818+0000","last_change":"2022-09-17T10:27:42.419293+0000","last_active":"2022-09-17T10:27:46.821818+0000","last_peered":"2022-09-17T10:27:46.821818+0000","last_clean":"2022-09-17T10:27:46.821818+0000","last_became_active":"2022-09-17T10:27:42.419016+0000","last_became_peered":"2022-09-17T10:27:42.419016+0000","last_unstale":"2022-09-17T10:27:46.821818+0000","last_undegraded":"2022-09-17T10:27:46.821818+0000","last_fullsized":"2022-09-17T10:27:46.821818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823777+0000","last_change":"2022-09-17T10:27:42.811222+0000","last_active":"2022-09-17T10:27:46.823777+0000","last_peered":"2022-09-17T10:27:46.823777+0000","last_clean":"2022-09-17T10:27:46.823777+0000","last_became_active":"2022-09-17T10:27:42.810431+0000","last_became_peered":"2022-09-17T10:27:42.810431+0000","last_unstale":"2022-09-17T10:27:46.823777+0000","last_undegraded":"2022-09-17T10:27:46.823777+0000","last_fullsized":"2022-09-17T10:27:46.823777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"26'1","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824396+0000","last_change":"2022-09-17T10:27:42.418764+0000","last_active":"2022-09-17T10:27:46.824396+0000","last_peered":"2022-09-17T10:27:46.824396+0000","last_clean":"2022-09-17T10:27:46.824396+0000","last_became_active":"2022-09-17T10:27:42.418460+0000","last_became_peered":"2022-09-17T10:27:42.418460+0000","last_unstale":"2022-09-17T10:27:46.824396+0000","last_undegraded":"2022-09-17T10:27:46.824396+0000","last_fullsized":"2022-09-17T10:27:46.824396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820837+0000","last_change":"2022-09-17T10:27:42.811297+0000","last_active":"2022-09-17T10:27:46.820837+0000","last_peered":"2022-09-17T10:27:46.820837+0000","last_clean":"2022-09-17T10:27:46.820837+0000","last_became_active":"2022-09-17T10:27:42.810563+0000","last_became_peered":"2022-09-17T10:27:42.810563+0000","last_unstale":"2022-09-17T10:27:46.820837+0000","last_undegraded":"2022-09-17T10:27:46.820837+0000","last_fullsized":"2022-09-17T10:27:46.820837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.881583+0000","last_change":"2022-09-17T10:27:46.879898+0000","last_active":"2022-09-17T10:27:46.881583+0000","last_peered":"2022-09-17T10:27:46.881583+0000","last_clean":"2022-09-17T10:27:46.881583+0000","last_became_active":"2022-09-17T10:27:46.877842+0000","last_became_peered":"2022-09-17T10:27:46.877842+0000","last_unstale":"2022-09-17T10:27:46.881583+0000","last_undegraded":"2022-09-17T10:27:46.881583+0000","last_fullsized":"2022-09-17T10:27:46.881583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831170+0000","last_change":"2022-09-17T10:27:42.426206+0000","last_active":"2022-09-17T10:27:46.831170+0000","last_peered":"2022-09-17T10:27:46.831170+0000","last_clean":"2022-09-17T10:27:46.831170+0000","last_became_active":"2022-09-17T10:27:42.425534+0000","last_became_peered":"2022-09-17T10:27:42.425534+0000","last_unstale":"2022-09-17T10:27:46.831170+0000","last_undegraded":"2022-09-17T10:27:46.831170+0000","last_fullsized":"2022-09-17T10:27:46.831170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823594+0000","last_change":"2022-09-17T10:27:42.805131+0000","last_active":"2022-09-17T10:27:46.823594+0000","last_peered":"2022-09-17T10:27:46.823594+0000","last_clean":"2022-09-17T10:27:46.823594+0000","last_became_active":"2022-09-17T10:27:42.804846+0000","last_became_peered":"2022-09-17T10:27:42.804846+0000","last_unstale":"2022-09-17T10:27:46.823594+0000","last_undegraded":"2022-09-17T10:27:46.823594+0000","last_fullsized":"2022-09-17T10:27:46.823594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838709+0000","last_change":"2022-09-17T10:27:46.833771+0000","last_active":"2022-09-17T10:27:46.838709+0000","last_peered":"2022-09-17T10:27:46.838709+0000","last_clean":"2022-09-17T10:27:46.838709+0000","last_became_active":"2022-09-17T10:27:46.833345+0000","last_became_peered":"2022-09-17T10:27:46.833345+0000","last_unstale":"2022-09-17T10:27:46.838709+0000","last_undegraded":"2022-09-17T10:27:46.838709+0000","last_fullsized":"2022-09-17T10:27:46.838709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826554+0000","last_change":"2022-09-17T10:27:42.422308+0000","last_active":"2022-09-17T10:27:46.826554+0000","last_peered":"2022-09-17T10:27:46.826554+0000","last_clean":"2022-09-17T10:27:46.826554+0000","last_became_active":"2022-09-17T10:27:42.422019+0000","last_became_peered":"2022-09-17T10:27:42.422019+0000","last_unstale":"2022-09-17T10:27:46.826554+0000","last_undegraded":"2022-09-17T10:27:46.826554+0000","last_fullsized":"2022-09-17T10:27:46.826554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821083+0000","last_change":"2022-09-17T10:27:42.810397+0000","last_active":"2022-09-17T10:27:46.821083+0000","last_peered":"2022-09-17T10:27:46.821083+0000","last_clean":"2022-09-17T10:27:46.821083+0000","last_became_active":"2022-09-17T10:27:42.810076+0000","last_became_peered":"2022-09-17T10:27:42.810076+0000","last_unstale":"2022-09-17T10:27:46.821083+0000","last_undegraded":"2022-09-17T10:27:46.821083+0000","last_fullsized":"2022-09-17T10:27:46.821083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839292+0000","last_change":"2022-09-17T10:27:46.836157+0000","last_active":"2022-09-17T10:27:46.839292+0000","last_peered":"2022-09-17T10:27:46.839292+0000","last_clean":"2022-09-17T10:27:46.839292+0000","last_became_active":"2022-09-17T10:27:46.835717+0000","last_became_peered":"2022-09-17T10:27:46.835717+0000","last_unstale":"2022-09-17T10:27:46.839292+0000","last_undegraded":"2022-09-17T10:27:46.839292+0000","last_fullsized":"2022-09-17T10:27:46.839292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827850+0000","last_change":"2022-09-17T10:27:42.414705+0000","last_active":"2022-09-17T10:27:46.827850+0000","last_peered":"2022-09-17T10:27:46.827850+0000","last_clean":"2022-09-17T10:27:46.827850+0000","last_became_active":"2022-09-17T10:27:42.414385+0000","last_became_peered":"2022-09-17T10:27:42.414385+0000","last_unstale":"2022-09-17T10:27:46.827850+0000","last_undegraded":"2022-09-17T10:27:46.827850+0000","last_fullsized":"2022-09-17T10:27:46.827850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820968+0000","last_change":"2022-09-17T10:27:42.817114+0000","last_active":"2022-09-17T10:27:46.820968+0000","last_peered":"2022-09-17T10:27:46.820968+0000","last_clean":"2022-09-17T10:27:46.820968+0000","last_became_active":"2022-09-17T10:27:42.816803+0000","last_became_peered":"2022-09-17T10:27:42.816803+0000","last_unstale":"2022-09-17T10:27:46.820968+0000","last_undegraded":"2022-09-17T10:27:46.820968+0000","last_fullsized":"2022-09-17T10:27:46.820968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879975+0000","last_change":"2022-09-17T10:27:46.878852+0000","last_active":"2022-09-17T10:27:46.879975+0000","last_peered":"2022-09-17T10:27:46.879975+0000","last_clean":"2022-09-17T10:27:46.879975+0000","last_became_active":"2022-09-17T10:27:46.878402+0000","last_became_peered":"2022-09-17T10:27:46.878402+0000","last_unstale":"2022-09-17T10:27:46.879975+0000","last_undegraded":"2022-09-17T10:27:46.879975+0000","last_fullsized":"2022-09-17T10:27:46.879975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.882394+0000","last_change":"2022-09-17T10:27:46.880930+0000","last_active":"2022-09-17T10:27:46.882394+0000","last_peered":"2022-09-17T10:27:46.882394+0000","last_clean":"2022-09-17T10:27:46.882394+0000","last_became_active":"2022-09-17T10:27:46.880498+0000","last_became_peered":"2022-09-17T10:27:46.880498+0000","last_unstale":"2022-09-17T10:27:46.882394+0000","last_undegraded":"2022-09-17T10:27:46.882394+0000","last_fullsized":"2022-09-17T10:27:46.882394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828368+0000","last_change":"2022-09-17T10:27:42.422458+0000","last_active":"2022-09-17T10:27:46.828368+0000","last_peered":"2022-09-17T10:27:46.828368+0000","last_clean":"2022-09-17T10:27:46.828368+0000","last_became_active":"2022-09-17T10:27:42.422187+0000","last_became_peered":"2022-09-17T10:27:42.422187+0000","last_unstale":"2022-09-17T10:27:46.828368+0000","last_undegraded":"2022-09-17T10:27:46.828368+0000","last_fullsized":"2022-09-17T10:27:46.828368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825686+0000","last_change":"2022-09-17T10:27:42.806970+0000","last_active":"2022-09-17T10:27:46.825686+0000","last_peered":"2022-09-17T10:27:46.825686+0000","last_clean":"2022-09-17T10:27:46.825686+0000","last_became_active":"2022-09-17T10:27:42.806322+0000","last_became_peered":"2022-09-17T10:27:42.806322+0000","last_unstale":"2022-09-17T10:27:46.825686+0000","last_undegraded":"2022-09-17T10:27:46.825686+0000","last_fullsized":"2022-09-17T10:27:46.825686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823713+0000","last_change":"2022-09-17T10:27:42.812236+0000","last_active":"2022-09-17T10:27:46.823713+0000","last_peered":"2022-09-17T10:27:46.823713+0000","last_clean":"2022-09-17T10:27:46.823713+0000","last_became_active":"2022-09-17T10:27:42.811869+0000","last_became_peered":"2022-09-17T10:27:42.811869+0000","last_unstale":"2022-09-17T10:27:46.823713+0000","last_undegraded":"2022-09-17T10:27:46.823713+0000","last_fullsized":"2022-09-17T10:27:46.823713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823142+0000","last_change":"2022-09-17T10:27:42.423679+0000","last_active":"2022-09-17T10:27:46.823142+0000","last_peered":"2022-09-17T10:27:46.823142+0000","last_clean":"2022-09-17T10:27:46.823142+0000","last_became_active":"2022-09-17T10:27:42.423382+0000","last_became_peered":"2022-09-17T10:27:42.423382+0000","last_unstale":"2022-09-17T10:27:46.823142+0000","last_undegraded":"2022-09-17T10:27:46.823142+0000","last_fullsized":"2022-09-17T10:27:46.823142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821044+0000","last_change":"2022-09-17T10:27:37.393333+0000","last_active":"2022-09-17T10:27:46.821044+0000","last_peered":"2022-09-17T10:27:46.821044+0000","last_clean":"2022-09-17T10:27:46.821044+0000","last_became_active":"2022-09-17T10:27:37.393020+0000","last_became_peered":"2022-09-17T10:27:37.393020+0000","last_unstale":"2022-09-17T10:27:46.821044+0000","last_undegraded":"2022-09-17T10:27:46.821044+0000","last_fullsized":"2022-09-17T10:27:46.821044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.836043+0000","last_change":"2022-09-17T10:27:46.833138+0000","last_active":"2022-09-17T10:27:46.836043+0000","last_peered":"2022-09-17T10:27:46.836043+0000","last_clean":"2022-09-17T10:27:46.836043+0000","last_became_active":"2022-09-17T10:27:46.832732+0000","last_became_peered":"2022-09-17T10:27:46.832732+0000","last_unstale":"2022-09-17T10:27:46.836043+0000","last_undegraded":"2022-09-17T10:27:46.836043+0000","last_fullsized":"2022-09-17T10:27:46.836043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830521+0000","last_change":"2022-09-17T10:27:42.808357+0000","last_active":"2022-09-17T10:27:46.830521+0000","last_peered":"2022-09-17T10:27:46.830521+0000","last_clean":"2022-09-17T10:27:46.830521+0000","last_became_active":"2022-09-17T10:27:42.808087+0000","last_became_peered":"2022-09-17T10:27:42.808087+0000","last_unstale":"2022-09-17T10:27:46.830521+0000","last_undegraded":"2022-09-17T10:27:46.830521+0000","last_fullsized":"2022-09-17T10:27:46.830521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823635+0000","last_change":"2022-09-17T10:27:37.394630+0000","last_active":"2022-09-17T10:27:46.823635+0000","last_peered":"2022-09-17T10:27:46.823635+0000","last_clean":"2022-09-17T10:27:46.823635+0000","last_became_active":"2022-09-17T10:27:37.394313+0000","last_became_peered":"2022-09-17T10:27:37.394313+0000","last_unstale":"2022-09-17T10:27:46.823635+0000","last_undegraded":"2022-09-17T10:27:46.823635+0000","last_fullsized":"2022-09-17T10:27:46.823635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831821+0000","last_change":"2022-09-17T10:27:42.423502+0000","last_active":"2022-09-17T10:27:46.831821+0000","last_peered":"2022-09-17T10:27:46.831821+0000","last_clean":"2022-09-17T10:27:46.831821+0000","last_became_active":"2022-09-17T10:27:42.423217+0000","last_became_peered":"2022-09-17T10:27:42.423217+0000","last_unstale":"2022-09-17T10:27:46.831821+0000","last_undegraded":"2022-09-17T10:27:46.831821+0000","last_fullsized":"2022-09-17T10:27:46.831821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839878+0000","last_change":"2022-09-17T10:27:46.837673+0000","last_active":"2022-09-17T10:27:46.839878+0000","last_peered":"2022-09-17T10:27:46.839878+0000","last_clean":"2022-09-17T10:27:46.839878+0000","last_became_active":"2022-09-17T10:27:46.837297+0000","last_became_peered":"2022-09-17T10:27:46.837297+0000","last_unstale":"2022-09-17T10:27:46.839878+0000","last_undegraded":"2022-09-17T10:27:46.839878+0000","last_fullsized":"2022-09-17T10:27:46.839878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821835+0000","last_change":"2022-09-17T10:27:42.817158+0000","last_active":"2022-09-17T10:27:46.821835+0000","last_peered":"2022-09-17T10:27:46.821835+0000","last_clean":"2022-09-17T10:27:46.821835+0000","last_became_active":"2022-09-17T10:27:42.816865+0000","last_became_peered":"2022-09-17T10:27:42.816865+0000","last_unstale":"2022-09-17T10:27:46.821835+0000","last_undegraded":"2022-09-17T10:27:46.821835+0000","last_fullsized":"2022-09-17T10:27:46.821835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877323+0000","last_change":"2022-09-17T10:27:42.420110+0000","last_active":"2022-09-17T10:27:46.877323+0000","last_peered":"2022-09-17T10:27:46.877323+0000","last_clean":"2022-09-17T10:27:46.877323+0000","last_became_active":"2022-09-17T10:27:42.419792+0000","last_became_peered":"2022-09-17T10:27:42.419792+0000","last_unstale":"2022-09-17T10:27:46.877323+0000","last_undegraded":"2022-09-17T10:27:46.877323+0000","last_fullsized":"2022-09-17T10:27:46.877323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832869+0000","last_change":"2022-09-17T10:27:37.518568+0000","last_active":"2022-09-17T10:27:46.832869+0000","last_peered":"2022-09-17T10:27:46.832869+0000","last_clean":"2022-09-17T10:27:46.832869+0000","last_became_active":"2022-09-17T10:27:37.518118+0000","last_became_peered":"2022-09-17T10:27:37.518118+0000","last_unstale":"2022-09-17T10:27:46.832869+0000","last_undegraded":"2022-09-17T10:27:46.832869+0000","last_fullsized":"2022-09-17T10:27:46.832869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.834941+0000","last_change":"2022-09-17T10:27:46.830735+0000","last_active":"2022-09-17T10:27:46.834941+0000","last_peered":"2022-09-17T10:27:46.834941+0000","last_clean":"2022-09-17T10:27:46.834941+0000","last_became_active":"2022-09-17T10:27:46.830221+0000","last_became_peered":"2022-09-17T10:27:46.830221+0000","last_unstale":"2022-09-17T10:27:46.834941+0000","last_undegraded":"2022-09-17T10:27:46.834941+0000","last_fullsized":"2022-09-17T10:27:46.834941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876839+0000","last_change":"2022-09-17T10:27:42.417099+0000","last_active":"2022-09-17T10:27:46.876839+0000","last_peered":"2022-09-17T10:27:46.876839+0000","last_clean":"2022-09-17T10:27:46.876839+0000","last_became_active":"2022-09-17T10:27:42.416817+0000","last_became_peered":"2022-09-17T10:27:42.416817+0000","last_unstale":"2022-09-17T10:27:46.876839+0000","last_undegraded":"2022-09-17T10:27:46.876839+0000","last_fullsized":"2022-09-17T10:27:46.876839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831235+0000","last_change":"2022-09-17T10:27:37.519776+0000","last_active":"2022-09-17T10:27:46.831235+0000","last_peered":"2022-09-17T10:27:46.831235+0000","last_clean":"2022-09-17T10:27:46.831235+0000","last_became_active":"2022-09-17T10:27:37.519419+0000","last_became_peered":"2022-09-17T10:27:37.519419+0000","last_unstale":"2022-09-17T10:27:46.831235+0000","last_undegraded":"2022-09-17T10:27:46.831235+0000","last_fullsized":"2022-09-17T10:27:46.831235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826040+0000","last_change":"2022-09-17T10:27:42.818131+0000","last_active":"2022-09-17T10:27:46.826040+0000","last_peered":"2022-09-17T10:27:46.826040+0000","last_clean":"2022-09-17T10:27:46.826040+0000","last_became_active":"2022-09-17T10:27:42.817852+0000","last_became_peered":"2022-09-17T10:27:42.817852+0000","last_unstale":"2022-09-17T10:27:46.826040+0000","last_undegraded":"2022-09-17T10:27:46.826040+0000","last_fullsized":"2022-09-17T10:27:46.826040+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838321+0000","last_change":"2022-09-17T10:27:46.836570+0000","last_active":"2022-09-17T10:27:46.838321+0000","last_peered":"2022-09-17T10:27:46.838321+0000","last_clean":"2022-09-17T10:27:46.838321+0000","last_became_active":"2022-09-17T10:27:46.836058+0000","last_became_peered":"2022-09-17T10:27:46.836058+0000","last_unstale":"2022-09-17T10:27:46.838321+0000","last_undegraded":"2022-09-17T10:27:46.838321+0000","last_fullsized":"2022-09-17T10:27:46.838321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831209+0000","last_change":"2022-09-17T10:27:42.421065+0000","last_active":"2022-09-17T10:27:46.831209+0000","last_peered":"2022-09-17T10:27:46.831209+0000","last_clean":"2022-09-17T10:27:46.831209+0000","last_became_active":"2022-09-17T10:27:42.420726+0000","last_became_peered":"2022-09-17T10:27:42.420726+0000","last_unstale":"2022-09-17T10:27:46.831209+0000","last_undegraded":"2022-09-17T10:27:46.831209+0000","last_fullsized":"2022-09-17T10:27:46.831209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826418+0000","last_change":"2022-09-17T10:27:34.683645+0000","last_active":"2022-09-17T10:27:46.826418+0000","last_peered":"2022-09-17T10:27:46.826418+0000","last_clean":"2022-09-17T10:27:46.826418+0000","last_became_active":"2022-09-17T10:27:34.683343+0000","last_became_peered":"2022-09-17T10:27:34.683343+0000","last_unstale":"2022-09-17T10:27:46.826418+0000","last_undegraded":"2022-09-17T10:27:46.826418+0000","last_fullsized":"2022-09-17T10:27:46.826418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:33.351685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:33.351685+0000","last_clean_scrub_stamp":"2022-09-17T10:27:33.351685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820922+0000","last_change":"2022-09-17T10:27:37.392686+0000","last_active":"2022-09-17T10:27:46.820922+0000","last_peered":"2022-09-17T10:27:46.820922+0000","last_clean":"2022-09-17T10:27:46.820922+0000","last_became_active":"2022-09-17T10:27:37.392465+0000","last_became_peered":"2022-09-17T10:27:37.392465+0000","last_unstale":"2022-09-17T10:27:46.820922+0000","last_undegraded":"2022-09-17T10:27:46.820922+0000","last_fullsized":"2022-09-17T10:27:46.820922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828213+0000","last_change":"2022-09-17T10:27:42.817727+0000","last_active":"2022-09-17T10:27:46.828213+0000","last_peered":"2022-09-17T10:27:46.828213+0000","last_clean":"2022-09-17T10:27:46.828213+0000","last_became_active":"2022-09-17T10:27:42.817394+0000","last_became_peered":"2022-09-17T10:27:42.817394+0000","last_unstale":"2022-09-17T10:27:46.828213+0000","last_undegraded":"2022-09-17T10:27:46.828213+0000","last_fullsized":"2022-09-17T10:27:46.828213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879456+0000","last_change":"2022-09-17T10:27:46.878670+0000","last_active":"2022-09-17T10:27:46.879456+0000","last_peered":"2022-09-17T10:27:46.879456+0000","last_clean":"2022-09-17T10:27:46.879456+0000","last_became_active":"2022-09-17T10:27:46.878229+0000","last_became_peered":"2022-09-17T10:27:46.878229+0000","last_unstale":"2022-09-17T10:27:46.879456+0000","last_undegraded":"2022-09-17T10:27:46.879456+0000","last_fullsized":"2022-09-17T10:27:46.879456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826285+0000","last_change":"2022-09-17T10:27:42.419675+0000","last_active":"2022-09-17T10:27:46.826285+0000","last_peered":"2022-09-17T10:27:46.826285+0000","last_clean":"2022-09-17T10:27:46.826285+0000","last_became_active":"2022-09-17T10:27:42.419276+0000","last_became_peered":"2022-09-17T10:27:42.419276+0000","last_unstale":"2022-09-17T10:27:46.826285+0000","last_undegraded":"2022-09-17T10:27:46.826285+0000","last_fullsized":"2022-09-17T10:27:46.826285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876695+0000","last_change":"2022-09-17T10:27:37.518223+0000","last_active":"2022-09-17T10:27:46.876695+0000","last_peered":"2022-09-17T10:27:46.876695+0000","last_clean":"2022-09-17T10:27:46.876695+0000","last_became_active":"2022-09-17T10:27:37.517883+0000","last_became_peered":"2022-09-17T10:27:37.517883+0000","last_unstale":"2022-09-17T10:27:46.876695+0000","last_undegraded":"2022-09-17T10:27:46.876695+0000","last_fullsized":"2022-09-17T10:27:46.876695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.878284+0000","last_change":"2022-09-17T10:27:42.817484+0000","last_active":"2022-09-17T10:27:46.878284+0000","last_peered":"2022-09-17T10:27:46.878284+0000","last_clean":"2022-09-17T10:27:46.878284+0000","last_became_active":"2022-09-17T10:27:42.817192+0000","last_became_peered":"2022-09-17T10:27:42.817192+0000","last_unstale":"2022-09-17T10:27:46.878284+0000","last_undegraded":"2022-09-17T10:27:46.878284+0000","last_fullsized":"2022-09-17T10:27:46.878284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879275+0000","last_change":"2022-09-17T10:27:46.878284+0000","last_active":"2022-09-17T10:27:46.879275+0000","last_peered":"2022-09-17T10:27:46.879275+0000","last_clean":"2022-09-17T10:27:46.879275+0000","last_became_active":"2022-09-17T10:27:46.877826+0000","last_became_peered":"2022-09-17T10:27:46.877826+0000","last_unstale":"2022-09-17T10:27:46.879275+0000","last_undegraded":"2022-09-17T10:27:46.879275+0000","last_fullsized":"2022-09-17T10:27:46.879275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877241+0000","last_change":"2022-09-17T10:27:42.805395+0000","last_active":"2022-09-17T10:27:46.877241+0000","last_peered":"2022-09-17T10:27:46.877241+0000","last_clean":"2022-09-17T10:27:46.877241+0000","last_became_active":"2022-09-17T10:27:42.805072+0000","last_became_peered":"2022-09-17T10:27:42.805072+0000","last_unstale":"2022-09-17T10:27:46.877241+0000","last_undegraded":"2022-09-17T10:27:46.877241+0000","last_fullsized":"2022-09-17T10:27:46.877241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823138+0000","last_change":"2022-09-17T10:27:42.422220+0000","last_active":"2022-09-17T10:27:46.823138+0000","last_peered":"2022-09-17T10:27:46.823138+0000","last_clean":"2022-09-17T10:27:46.823138+0000","last_became_active":"2022-09-17T10:27:42.421941+0000","last_became_peered":"2022-09-17T10:27:42.421941+0000","last_unstale":"2022-09-17T10:27:46.823138+0000","last_undegraded":"2022-09-17T10:27:46.823138+0000","last_fullsized":"2022-09-17T10:27:46.823138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827201+0000","last_change":"2022-09-17T10:27:37.394582+0000","last_active":"2022-09-17T10:27:46.827201+0000","last_peered":"2022-09-17T10:27:46.827201+0000","last_clean":"2022-09-17T10:27:46.827201+0000","last_became_active":"2022-09-17T10:27:37.394285+0000","last_became_peered":"2022-09-17T10:27:37.394285+0000","last_unstale":"2022-09-17T10:27:46.827201+0000","last_undegraded":"2022-09-17T10:27:46.827201+0000","last_fullsized":"2022-09-17T10:27:46.827201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.881600+0000","last_change":"2022-09-17T10:27:46.880385+0000","last_active":"2022-09-17T10:27:46.881600+0000","last_peered":"2022-09-17T10:27:46.881600+0000","last_clean":"2022-09-17T10:27:46.881600+0000","last_became_active":"2022-09-17T10:27:46.878700+0000","last_became_peered":"2022-09-17T10:27:46.878700+0000","last_unstale":"2022-09-17T10:27:46.881600+0000","last_undegraded":"2022-09-17T10:27:46.881600+0000","last_fullsized":"2022-09-17T10:27:46.881600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832695+0000","last_change":"2022-09-17T10:27:42.817890+0000","last_active":"2022-09-17T10:27:46.832695+0000","last_peered":"2022-09-17T10:27:46.832695+0000","last_clean":"2022-09-17T10:27:46.832695+0000","last_became_active":"2022-09-17T10:27:42.817601+0000","last_became_peered":"2022-09-17T10:27:42.817601+0000","last_unstale":"2022-09-17T10:27:46.832695+0000","last_undegraded":"2022-09-17T10:27:46.832695+0000","last_fullsized":"2022-09-17T10:27:46.832695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823749+0000","last_change":"2022-09-17T10:27:42.423365+0000","last_active":"2022-09-17T10:27:46.823749+0000","last_peered":"2022-09-17T10:27:46.823749+0000","last_clean":"2022-09-17T10:27:46.823749+0000","last_became_active":"2022-09-17T10:27:42.423033+0000","last_became_peered":"2022-09-17T10:27:42.423033+0000","last_unstale":"2022-09-17T10:27:46.823749+0000","last_undegraded":"2022-09-17T10:27:46.823749+0000","last_fullsized":"2022-09-17T10:27:46.823749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823623+0000","last_change":"2022-09-17T10:27:37.525398+0000","last_active":"2022-09-17T10:27:46.823623+0000","last_peered":"2022-09-17T10:27:46.823623+0000","last_clean":"2022-09-17T10:27:46.823623+0000","last_became_active":"2022-09-17T10:27:37.525103+0000","last_became_peered":"2022-09-17T10:27:37.525103+0000","last_unstale":"2022-09-17T10:27:46.823623+0000","last_undegraded":"2022-09-17T10:27:46.823623+0000","last_fullsized":"2022-09-17T10:27:46.823623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879752+0000","last_change":"2022-09-17T10:27:46.877751+0000","last_active":"2022-09-17T10:27:46.879752+0000","last_peered":"2022-09-17T10:27:46.879752+0000","last_clean":"2022-09-17T10:27:46.879752+0000","last_became_active":"2022-09-17T10:27:46.877299+0000","last_became_peered":"2022-09-17T10:27:46.877299+0000","last_unstale":"2022-09-17T10:27:46.879752+0000","last_undegraded":"2022-09-17T10:27:46.879752+0000","last_fullsized":"2022-09-17T10:27:46.879752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823812+0000","last_change":"2022-09-17T10:27:42.420366+0000","last_active":"2022-09-17T10:27:46.823812+0000","last_peered":"2022-09-17T10:27:46.823812+0000","last_clean":"2022-09-17T10:27:46.823812+0000","last_became_active":"2022-09-17T10:27:42.420013+0000","last_became_peered":"2022-09-17T10:27:42.420013+0000","last_unstale":"2022-09-17T10:27:46.823812+0000","last_undegraded":"2022-09-17T10:27:46.823812+0000","last_fullsized":"2022-09-17T10:27:46.823812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824918+0000","last_change":"2022-09-17T10:27:42.806721+0000","last_active":"2022-09-17T10:27:46.824918+0000","last_peered":"2022-09-17T10:27:46.824918+0000","last_clean":"2022-09-17T10:27:46.824918+0000","last_became_active":"2022-09-17T10:27:42.806357+0000","last_became_peered":"2022-09-17T10:27:42.806357+0000","last_unstale":"2022-09-17T10:27:46.824918+0000","last_undegraded":"2022-09-17T10:27:46.824918+0000","last_fullsized":"2022-09-17T10:27:46.824918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.882851+0000","last_change":"2022-09-17T10:27:46.882310+0000","last_active":"2022-09-17T10:27:46.882851+0000","last_peered":"2022-09-17T10:27:46.882851+0000","last_clean":"2022-09-17T10:27:46.882851+0000","last_became_active":"2022-09-17T10:27:46.881958+0000","last_became_peered":"2022-09-17T10:27:46.881958+0000","last_unstale":"2022-09-17T10:27:46.882851+0000","last_undegraded":"2022-09-17T10:27:46.882851+0000","last_fullsized":"2022-09-17T10:27:46.882851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832635+0000","last_change":"2022-09-17T10:27:42.420727+0000","last_active":"2022-09-17T10:27:46.832635+0000","last_peered":"2022-09-17T10:27:46.832635+0000","last_clean":"2022-09-17T10:27:46.832635+0000","last_became_active":"2022-09-17T10:27:42.420318+0000","last_became_peered":"2022-09-17T10:27:42.420318+0000","last_unstale":"2022-09-17T10:27:46.832635+0000","last_undegraded":"2022-09-17T10:27:46.832635+0000","last_fullsized":"2022-09-17T10:27:46.832635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821086+0000","last_change":"2022-09-17T10:27:42.816236+0000","last_active":"2022-09-17T10:27:46.821086+0000","last_peered":"2022-09-17T10:27:46.821086+0000","last_clean":"2022-09-17T10:27:46.821086+0000","last_became_active":"2022-09-17T10:27:42.815964+0000","last_became_peered":"2022-09-17T10:27:42.815964+0000","last_unstale":"2022-09-17T10:27:46.821086+0000","last_undegraded":"2022-09-17T10:27:46.821086+0000","last_fullsized":"2022-09-17T10:27:46.821086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838996+0000","last_change":"2022-09-17T10:27:46.833473+0000","last_active":"2022-09-17T10:27:46.838996+0000","last_peered":"2022-09-17T10:27:46.838996+0000","last_clean":"2022-09-17T10:27:46.838996+0000","last_became_active":"2022-09-17T10:27:46.832774+0000","last_became_peered":"2022-09-17T10:27:46.832774+0000","last_unstale":"2022-09-17T10:27:46.838996+0000","last_undegraded":"2022-09-17T10:27:46.838996+0000","last_fullsized":"2022-09-17T10:27:46.838996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826647+0000","last_change":"2022-09-17T10:27:42.417006+0000","last_active":"2022-09-17T10:27:46.826647+0000","last_peered":"2022-09-17T10:27:46.826647+0000","last_clean":"2022-09-17T10:27:46.826647+0000","last_became_active":"2022-09-17T10:27:42.416679+0000","last_became_peered":"2022-09-17T10:27:42.416679+0000","last_unstale":"2022-09-17T10:27:46.826647+0000","last_undegraded":"2022-09-17T10:27:46.826647+0000","last_fullsized":"2022-09-17T10:27:46.826647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821361+0000","last_change":"2022-09-17T10:27:42.814951+0000","last_active":"2022-09-17T10:27:46.821361+0000","last_peered":"2022-09-17T10:27:46.821361+0000","last_clean":"2022-09-17T10:27:46.821361+0000","last_became_active":"2022-09-17T10:27:42.814659+0000","last_became_peered":"2022-09-17T10:27:42.814659+0000","last_unstale":"2022-09-17T10:27:46.821361+0000","last_undegraded":"2022-09-17T10:27:46.821361+0000","last_fullsized":"2022-09-17T10:27:46.821361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.836181+0000","last_change":"2022-09-17T10:27:46.835414+0000","last_active":"2022-09-17T10:27:46.836181+0000","last_peered":"2022-09-17T10:27:46.836181+0000","last_clean":"2022-09-17T10:27:46.836181+0000","last_became_active":"2022-09-17T10:27:46.834968+0000","last_became_peered":"2022-09-17T10:27:46.834968+0000","last_unstale":"2022-09-17T10:27:46.836181+0000","last_undegraded":"2022-09-17T10:27:46.836181+0000","last_fullsized":"2022-09-17T10:27:46.836181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830835+0000","last_change":"2022-09-17T10:27:42.422793+0000","last_active":"2022-09-17T10:27:46.830835+0000","last_peered":"2022-09-17T10:27:46.830835+0000","last_clean":"2022-09-17T10:27:46.830835+0000","last_became_active":"2022-09-17T10:27:42.422337+0000","last_became_peered":"2022-09-17T10:27:42.422337+0000","last_unstale":"2022-09-17T10:27:46.830835+0000","last_undegraded":"2022-09-17T10:27:46.830835+0000","last_fullsized":"2022-09-17T10:27:46.830835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822194+0000","last_change":"2022-09-17T10:27:42.811550+0000","last_active":"2022-09-17T10:27:46.822194+0000","last_peered":"2022-09-17T10:27:46.822194+0000","last_clean":"2022-09-17T10:27:46.822194+0000","last_became_active":"2022-09-17T10:27:42.811253+0000","last_became_peered":"2022-09-17T10:27:42.811253+0000","last_unstale":"2022-09-17T10:27:46.822194+0000","last_undegraded":"2022-09-17T10:27:46.822194+0000","last_fullsized":"2022-09-17T10:27:46.822194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838391+0000","last_change":"2022-09-17T10:27:46.835511+0000","last_active":"2022-09-17T10:27:46.838391+0000","last_peered":"2022-09-17T10:27:46.838391+0000","last_clean":"2022-09-17T10:27:46.838391+0000","last_became_active":"2022-09-17T10:27:46.835134+0000","last_became_peered":"2022-09-17T10:27:46.835134+0000","last_unstale":"2022-09-17T10:27:46.838391+0000","last_undegraded":"2022-09-17T10:27:46.838391+0000","last_fullsized":"2022-09-17T10:27:46.838391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826910+0000","last_change":"2022-09-17T10:27:42.422231+0000","last_active":"2022-09-17T10:27:46.826910+0000","last_peered":"2022-09-17T10:27:46.826910+0000","last_clean":"2022-09-17T10:27:46.826910+0000","last_became_active":"2022-09-17T10:27:42.421108+0000","last_became_peered":"2022-09-17T10:27:42.421108+0000","last_unstale":"2022-09-17T10:27:46.826910+0000","last_undegraded":"2022-09-17T10:27:46.826910+0000","last_fullsized":"2022-09-17T10:27:46.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824550+0000","last_change":"2022-09-17T10:27:42.806733+0000","last_active":"2022-09-17T10:27:46.824550+0000","last_peered":"2022-09-17T10:27:46.824550+0000","last_clean":"2022-09-17T10:27:46.824550+0000","last_became_active":"2022-09-17T10:27:42.806446+0000","last_became_peered":"2022-09-17T10:27:42.806446+0000","last_unstale":"2022-09-17T10:27:46.824550+0000","last_undegraded":"2022-09-17T10:27:46.824550+0000","last_fullsized":"2022-09-17T10:27:46.824550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839217+0000","last_change":"2022-09-17T10:27:46.836402+0000","last_active":"2022-09-17T10:27:46.839217+0000","last_peered":"2022-09-17T10:27:46.839217+0000","last_clean":"2022-09-17T10:27:46.839217+0000","last_became_active":"2022-09-17T10:27:46.836002+0000","last_became_peered":"2022-09-17T10:27:46.836002+0000","last_unstale":"2022-09-17T10:27:46.839217+0000","last_undegraded":"2022-09-17T10:27:46.839217+0000","last_fullsized":"2022-09-17T10:27:46.839217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828495+0000","last_change":"2022-09-17T10:27:42.421493+0000","last_active":"2022-09-17T10:27:46.828495+0000","last_peered":"2022-09-17T10:27:46.828495+0000","last_clean":"2022-09-17T10:27:46.828495+0000","last_became_active":"2022-09-17T10:27:42.421137+0000","last_became_peered":"2022-09-17T10:27:42.421137+0000","last_unstale":"2022-09-17T10:27:46.828495+0000","last_undegraded":"2022-09-17T10:27:46.828495+0000","last_fullsized":"2022-09-17T10:27:46.828495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828502+0000","last_change":"2022-09-17T10:27:42.812206+0000","last_active":"2022-09-17T10:27:46.828502+0000","last_peered":"2022-09-17T10:27:46.828502+0000","last_clean":"2022-09-17T10:27:46.828502+0000","last_became_active":"2022-09-17T10:27:42.811911+0000","last_became_peered":"2022-09-17T10:27:42.811911+0000","last_unstale":"2022-09-17T10:27:46.828502+0000","last_undegraded":"2022-09-17T10:27:46.828502+0000","last_fullsized":"2022-09-17T10:27:46.828502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.837793+0000","last_change":"2022-09-17T10:27:46.836695+0000","last_active":"2022-09-17T10:27:46.837793+0000","last_peered":"2022-09-17T10:27:46.837793+0000","last_clean":"2022-09-17T10:27:46.837793+0000","last_became_active":"2022-09-17T10:27:46.836236+0000","last_became_peered":"2022-09-17T10:27:46.836236+0000","last_unstale":"2022-09-17T10:27:46.837793+0000","last_undegraded":"2022-09-17T10:27:46.837793+0000","last_fullsized":"2022-09-17T10:27:46.837793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822969+0000","last_change":"2022-09-17T10:27:42.418839+0000","last_active":"2022-09-17T10:27:46.822969+0000","last_peered":"2022-09-17T10:27:46.822969+0000","last_clean":"2022-09-17T10:27:46.822969+0000","last_became_active":"2022-09-17T10:27:42.418555+0000","last_became_peered":"2022-09-17T10:27:42.418555+0000","last_unstale":"2022-09-17T10:27:46.822969+0000","last_undegraded":"2022-09-17T10:27:46.822969+0000","last_fullsized":"2022-09-17T10:27:46.822969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825849+0000","last_change":"2022-09-17T10:27:42.820270+0000","last_active":"2022-09-17T10:27:46.825849+0000","last_peered":"2022-09-17T10:27:46.825849+0000","last_clean":"2022-09-17T10:27:46.825849+0000","last_became_active":"2022-09-17T10:27:42.820082+0000","last_became_peered":"2022-09-17T10:27:42.820082+0000","last_unstale":"2022-09-17T10:27:46.825849+0000","last_undegraded":"2022-09-17T10:27:46.825849+0000","last_fullsized":"2022-09-17T10:27:46.825849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832187+0000","last_change":"2022-09-17T10:27:46.830924+0000","last_active":"2022-09-17T10:27:46.832187+0000","last_peered":"2022-09-17T10:27:46.832187+0000","last_clean":"2022-09-17T10:27:46.832187+0000","last_became_active":"2022-09-17T10:27:46.830492+0000","last_became_peered":"2022-09-17T10:27:46.830492+0000","last_unstale":"2022-09-17T10:27:46.832187+0000","last_undegraded":"2022-09-17T10:27:46.832187+0000","last_fullsized":"2022-09-17T10:27:46.832187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830951+0000","last_change":"2022-09-17T10:27:42.419790+0000","last_active":"2022-09-17T10:27:46.830951+0000","last_peered":"2022-09-17T10:27:46.830951+0000","last_clean":"2022-09-17T10:27:46.830951+0000","last_became_active":"2022-09-17T10:27:42.419230+0000","last_became_peered":"2022-09-17T10:27:42.419230+0000","last_unstale":"2022-09-17T10:27:46.830951+0000","last_undegraded":"2022-09-17T10:27:46.830951+0000","last_fullsized":"2022-09-17T10:27:46.830951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825970+0000","last_change":"2022-09-17T10:27:42.818878+0000","last_active":"2022-09-17T10:27:46.825970+0000","last_peered":"2022-09-17T10:27:46.825970+0000","last_clean":"2022-09-17T10:27:46.825970+0000","last_became_active":"2022-09-17T10:27:42.818634+0000","last_became_peered":"2022-09-17T10:27:42.818634+0000","last_unstale":"2022-09-17T10:27:46.825970+0000","last_undegraded":"2022-09-17T10:27:46.825970+0000","last_fullsized":"2022-09-17T10:27:46.825970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839835+0000","last_change":"2022-09-17T10:27:46.832459+0000","last_active":"2022-09-17T10:27:46.839835+0000","last_peered":"2022-09-17T10:27:46.839835+0000","last_clean":"2022-09-17T10:27:46.839835+0000","last_became_active":"2022-09-17T10:27:46.831882+0000","last_became_peered":"2022-09-17T10:27:46.831882+0000","last_unstale":"2022-09-17T10:27:46.839835+0000","last_undegraded":"2022-09-17T10:27:46.839835+0000","last_fullsized":"2022-09-17T10:27:46.839835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"26'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826302+0000","last_change":"2022-09-17T10:27:42.418968+0000","last_active":"2022-09-17T10:27:46.826302+0000","last_peered":"2022-09-17T10:27:46.826302+0000","last_clean":"2022-09-17T10:27:46.826302+0000","last_became_active":"2022-09-17T10:27:42.418688+0000","last_became_peered":"2022-09-17T10:27:42.418688+0000","last_unstale":"2022-09-17T10:27:46.826302+0000","last_undegraded":"2022-09-17T10:27:46.826302+0000","last_fullsized":"2022-09-17T10:27:46.826302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824990+0000","last_change":"2022-09-17T10:27:42.811058+0000","last_active":"2022-09-17T10:27:46.824990+0000","last_peered":"2022-09-17T10:27:46.824990+0000","last_clean":"2022-09-17T10:27:46.824990+0000","last_became_active":"2022-09-17T10:27:42.810786+0000","last_became_peered":"2022-09-17T10:27:42.810786+0000","last_unstale":"2022-09-17T10:27:46.824990+0000","last_undegraded":"2022-09-17T10:27:46.824990+0000","last_fullsized":"2022-09-17T10:27:46.824990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879743+0000","last_change":"2022-09-17T10:27:46.878357+0000","last_active":"2022-09-17T10:27:46.879743+0000","last_peered":"2022-09-17T10:27:46.879743+0000","last_clean":"2022-09-17T10:27:46.879743+0000","last_became_active":"2022-09-17T10:27:46.877905+0000","last_became_peered":"2022-09-17T10:27:46.877905+0000","last_unstale":"2022-09-17T10:27:46.879743+0000","last_undegraded":"2022-09-17T10:27:46.879743+0000","last_fullsized":"2022-09-17T10:27:46.879743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825843+0000","last_change":"2022-09-17T10:27:42.423000+0000","last_active":"2022-09-17T10:27:46.825843+0000","last_peered":"2022-09-17T10:27:46.825843+0000","last_clean":"2022-09-17T10:27:46.825843+0000","last_became_active":"2022-09-17T10:27:42.422682+0000","last_became_peered":"2022-09-17T10:27:42.422682+0000","last_unstale":"2022-09-17T10:27:46.825843+0000","last_undegraded":"2022-09-17T10:27:46.825843+0000","last_fullsized":"2022-09-17T10:27:46.825843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879543+0000","last_change":"2022-09-17T10:27:42.811159+0000","last_active":"2022-09-17T10:27:46.879543+0000","last_peered":"2022-09-17T10:27:46.879543+0000","last_clean":"2022-09-17T10:27:46.879543+0000","last_became_active":"2022-09-17T10:27:42.810820+0000","last_became_peered":"2022-09-17T10:27:42.810820+0000","last_unstale":"2022-09-17T10:27:46.879543+0000","last_undegraded":"2022-09-17T10:27:46.879543+0000","last_fullsized":"2022-09-17T10:27:46.879543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839921+0000","last_change":"2022-09-17T10:27:46.838653+0000","last_active":"2022-09-17T10:27:46.839921+0000","last_peered":"2022-09-17T10:27:46.839921+0000","last_clean":"2022-09-17T10:27:46.839921+0000","last_became_active":"2022-09-17T10:27:46.838287+0000","last_became_peered":"2022-09-17T10:27:46.838287+0000","last_unstale":"2022-09-17T10:27:46.839921+0000","last_undegraded":"2022-09-17T10:27:46.839921+0000","last_fullsized":"2022-09-17T10:27:46.839921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877630+0000","last_change":"2022-09-17T10:27:42.419648+0000","last_active":"2022-09-17T10:27:46.877630+0000","last_peered":"2022-09-17T10:27:46.877630+0000","last_clean":"2022-09-17T10:27:46.877630+0000","last_became_active":"2022-09-17T10:27:42.419364+0000","last_became_peered":"2022-09-17T10:27:42.419364+0000","last_unstale":"2022-09-17T10:27:46.877630+0000","last_undegraded":"2022-09-17T10:27:46.877630+0000","last_fullsized":"2022-09-17T10:27:46.877630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826647+0000","last_change":"2022-09-17T10:27:42.816825+0000","last_active":"2022-09-17T10:27:46.826647+0000","last_peered":"2022-09-17T10:27:46.826647+0000","last_clean":"2022-09-17T10:27:46.826647+0000","last_became_active":"2022-09-17T10:27:42.816570+0000","last_became_peered":"2022-09-17T10:27:42.816570+0000","last_unstale":"2022-09-17T10:27:46.826647+0000","last_undegraded":"2022-09-17T10:27:46.826647+0000","last_fullsized":"2022-09-17T10:27:46.826647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841041+0000","last_change":"2022-09-17T10:27:46.840020+0000","last_active":"2022-09-17T10:27:46.841041+0000","last_peered":"2022-09-17T10:27:46.841041+0000","last_clean":"2022-09-17T10:27:46.841041+0000","last_became_active":"2022-09-17T10:27:46.839506+0000","last_became_peered":"2022-09-17T10:27:46.839506+0000","last_unstale":"2022-09-17T10:27:46.841041+0000","last_undegraded":"2022-09-17T10:27:46.841041+0000","last_fullsized":"2022-09-17T10:27:46.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825124+0000","last_change":"2022-09-17T10:27:42.422080+0000","last_active":"2022-09-17T10:27:46.825124+0000","last_peered":"2022-09-17T10:27:46.825124+0000","last_clean":"2022-09-17T10:27:46.825124+0000","last_became_active":"2022-09-17T10:27:42.421800+0000","last_became_peered":"2022-09-17T10:27:42.421800+0000","last_unstale":"2022-09-17T10:27:46.825124+0000","last_undegraded":"2022-09-17T10:27:46.825124+0000","last_fullsized":"2022-09-17T10:27:46.825124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822002+0000","last_change":"2022-09-17T10:27:42.813833+0000","last_active":"2022-09-17T10:27:46.822002+0000","last_peered":"2022-09-17T10:27:46.822002+0000","last_clean":"2022-09-17T10:27:46.822002+0000","last_became_active":"2022-09-17T10:27:42.813026+0000","last_became_peered":"2022-09-17T10:27:42.813026+0000","last_unstale":"2022-09-17T10:27:46.822002+0000","last_undegraded":"2022-09-17T10:27:46.822002+0000","last_fullsized":"2022-09-17T10:27:46.822002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838329+0000","last_change":"2022-09-17T10:27:46.836347+0000","last_active":"2022-09-17T10:27:46.838329+0000","last_peered":"2022-09-17T10:27:46.838329+0000","last_clean":"2022-09-17T10:27:46.838329+0000","last_became_active":"2022-09-17T10:27:46.835868+0000","last_became_peered":"2022-09-17T10:27:46.835868+0000","last_unstale":"2022-09-17T10:27:46.838329+0000","last_undegraded":"2022-09-17T10:27:46.838329+0000","last_fullsized":"2022-09-17T10:27:46.838329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827978+0000","last_change":"2022-09-17T10:27:42.418108+0000","last_active":"2022-09-17T10:27:46.827978+0000","last_peered":"2022-09-17T10:27:46.827978+0000","last_clean":"2022-09-17T10:27:46.827978+0000","last_became_active":"2022-09-17T10:27:42.417757+0000","last_became_peered":"2022-09-17T10:27:42.417757+0000","last_unstale":"2022-09-17T10:27:46.827978+0000","last_undegraded":"2022-09-17T10:27:46.827978+0000","last_fullsized":"2022-09-17T10:27:46.827978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821123+0000","last_change":"2022-09-17T10:27:42.817463+0000","last_active":"2022-09-17T10:27:46.821123+0000","last_peered":"2022-09-17T10:27:46.821123+0000","last_clean":"2022-09-17T10:27:46.821123+0000","last_became_active":"2022-09-17T10:27:42.816834+0000","last_became_peered":"2022-09-17T10:27:42.816834+0000","last_unstale":"2022-09-17T10:27:46.821123+0000","last_undegraded":"2022-09-17T10:27:46.821123+0000","last_fullsized":"2022-09-17T10:27:46.821123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841734+0000","last_change":"2022-09-17T10:27:46.841024+0000","last_active":"2022-09-17T10:27:46.841734+0000","last_peered":"2022-09-17T10:27:46.841734+0000","last_clean":"2022-09-17T10:27:46.841734+0000","last_became_active":"2022-09-17T10:27:46.840603+0000","last_became_peered":"2022-09-17T10:27:46.840603+0000","last_unstale":"2022-09-17T10:27:46.841734+0000","last_undegraded":"2022-09-17T10:27:46.841734+0000","last_fullsized":"2022-09-17T10:27:46.841734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"26'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832780+0000","last_change":"2022-09-17T10:27:42.420701+0000","last_active":"2022-09-17T10:27:46.832780+0000","last_peered":"2022-09-17T10:27:46.832780+0000","last_clean":"2022-09-17T10:27:46.832780+0000","last_became_active":"2022-09-17T10:27:42.420411+0000","last_became_peered":"2022-09-17T10:27:42.420411+0000","last_unstale":"2022-09-17T10:27:46.832780+0000","last_undegraded":"2022-09-17T10:27:46.832780+0000","last_fullsized":"2022-09-17T10:27:46.832780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824113+0000","last_change":"2022-09-17T10:27:42.815787+0000","last_active":"2022-09-17T10:27:46.824113+0000","last_peered":"2022-09-17T10:27:46.824113+0000","last_clean":"2022-09-17T10:27:46.824113+0000","last_became_active":"2022-09-17T10:27:42.815574+0000","last_became_peered":"2022-09-17T10:27:42.815574+0000","last_unstale":"2022-09-17T10:27:46.824113+0000","last_undegraded":"2022-09-17T10:27:46.824113+0000","last_fullsized":"2022-09-17T10:27:46.824113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841390+0000","last_change":"2022-09-17T10:27:46.840878+0000","last_active":"2022-09-17T10:27:46.841390+0000","last_peered":"2022-09-17T10:27:46.841390+0000","last_clean":"2022-09-17T10:27:46.841390+0000","last_became_active":"2022-09-17T10:27:46.840406+0000","last_became_peered":"2022-09-17T10:27:46.840406+0000","last_unstale":"2022-09-17T10:27:46.841390+0000","last_undegraded":"2022-09-17T10:27:46.841390+0000","last_fullsized":"2022-09-17T10:27:46.841390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.829101+0000","last_change":"2022-09-17T10:27:42.416329+0000","last_active":"2022-09-17T10:27:46.829101+0000","last_peered":"2022-09-17T10:27:46.829101+0000","last_clean":"2022-09-17T10:27:46.829101+0000","last_became_active":"2022-09-17T10:27:42.415993+0000","last_became_peered":"2022-09-17T10:27:42.415993+0000","last_unstale":"2022-09-17T10:27:46.829101+0000","last_undegraded":"2022-09-17T10:27:46.829101+0000","last_fullsized":"2022-09-17T10:27:46.829101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831132+0000","last_change":"2022-09-17T10:27:42.816319+0000","last_active":"2022-09-17T10:27:46.831132+0000","last_peered":"2022-09-17T10:27:46.831132+0000","last_clean":"2022-09-17T10:27:46.831132+0000","last_became_active":"2022-09-17T10:27:42.815852+0000","last_became_peered":"2022-09-17T10:27:42.815852+0000","last_unstale":"2022-09-17T10:27:46.831132+0000","last_undegraded":"2022-09-17T10:27:46.831132+0000","last_fullsized":"2022-09-17T10:27:46.831132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838936+0000","last_change":"2022-09-17T10:27:46.834933+0000","last_active":"2022-09-17T10:27:46.838936+0000","last_peered":"2022-09-17T10:27:46.838936+0000","last_clean":"2022-09-17T10:27:46.838936+0000","last_became_active":"2022-09-17T10:27:46.834522+0000","last_became_peered":"2022-09-17T10:27:46.834522+0000","last_unstale":"2022-09-17T10:27:46.838936+0000","last_undegraded":"2022-09-17T10:27:46.838936+0000","last_fullsized":"2022-09-17T10:27:46.838936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823794+0000","last_change":"2022-09-17T10:27:42.421873+0000","last_active":"2022-09-17T10:27:46.823794+0000","last_peered":"2022-09-17T10:27:46.823794+0000","last_clean":"2022-09-17T10:27:46.823794+0000","last_became_active":"2022-09-17T10:27:42.421587+0000","last_became_peered":"2022-09-17T10:27:42.421587+0000","last_unstale":"2022-09-17T10:27:46.823794+0000","last_undegraded":"2022-09-17T10:27:46.823794+0000","last_fullsized":"2022-09-17T10:27:46.823794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823867+0000","last_change":"2022-09-17T10:27:42.805008+0000","last_active":"2022-09-17T10:27:46.823867+0000","last_peered":"2022-09-17T10:27:46.823867+0000","last_clean":"2022-09-17T10:27:46.823867+0000","last_became_active":"2022-09-17T10:27:42.804736+0000","last_became_peered":"2022-09-17T10:27:42.804736+0000","last_unstale":"2022-09-17T10:27:46.823867+0000","last_undegraded":"2022-09-17T10:27:46.823867+0000","last_fullsized":"2022-09-17T10:27:46.823867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.840417+0000","last_change":"2022-09-17T10:27:46.839700+0000","last_active":"2022-09-17T10:27:46.840417+0000","last_peered":"2022-09-17T10:27:46.840417+0000","last_clean":"2022-09-17T10:27:46.840417+0000","last_became_active":"2022-09-17T10:27:46.839222+0000","last_became_peered":"2022-09-17T10:27:46.839222+0000","last_unstale":"2022-09-17T10:27:46.840417+0000","last_undegraded":"2022-09-17T10:27:46.840417+0000","last_fullsized":"2022-09-17T10:27:46.840417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.837453+0000","last_change":"2022-09-17T10:27:46.835973+0000","last_active":"2022-09-17T10:27:46.837453+0000","last_peered":"2022-09-17T10:27:46.837453+0000","last_clean":"2022-09-17T10:27:46.837453+0000","last_became_active":"2022-09-17T10:27:46.835370+0000","last_became_peered":"2022-09-17T10:27:46.835370+0000","last_unstale":"2022-09-17T10:27:46.837453+0000","last_undegraded":"2022-09-17T10:27:46.837453+0000","last_fullsized":"2022-09-17T10:27:46.837453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830729+0000","last_change":"2022-09-17T10:27:42.424396+0000","last_active":"2022-09-17T10:27:46.830729+0000","last_peered":"2022-09-17T10:27:46.830729+0000","last_clean":"2022-09-17T10:27:46.830729+0000","last_became_active":"2022-09-17T10:27:42.424106+0000","last_became_peered":"2022-09-17T10:27:42.424106+0000","last_unstale":"2022-09-17T10:27:46.830729+0000","last_undegraded":"2022-09-17T10:27:46.830729+0000","last_fullsized":"2022-09-17T10:27:46.830729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822522+0000","last_change":"2022-09-17T10:27:42.813371+0000","last_active":"2022-09-17T10:27:46.822522+0000","last_peered":"2022-09-17T10:27:46.822522+0000","last_clean":"2022-09-17T10:27:46.822522+0000","last_became_active":"2022-09-17T10:27:42.813093+0000","last_became_peered":"2022-09-17T10:27:42.813093+0000","last_unstale":"2022-09-17T10:27:46.822522+0000","last_undegraded":"2022-09-17T10:27:46.822522+0000","last_fullsized":"2022-09-17T10:27:46.822522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838300+0000","last_change":"2022-09-17T10:27:46.836367+0000","last_active":"2022-09-17T10:27:46.838300+0000","last_peered":"2022-09-17T10:27:46.838300+0000","last_clean":"2022-09-17T10:27:46.838300+0000","last_became_active":"2022-09-17T10:27:46.835670+0000","last_became_peered":"2022-09-17T10:27:46.835670+0000","last_unstale":"2022-09-17T10:27:46.838300+0000","last_undegraded":"2022-09-17T10:27:46.838300+0000","last_fullsized":"2022-09-17T10:27:46.838300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823937+0000","last_change":"2022-09-17T10:27:42.425999+0000","last_active":"2022-09-17T10:27:46.823937+0000","last_peered":"2022-09-17T10:27:46.823937+0000","last_clean":"2022-09-17T10:27:46.823937+0000","last_became_active":"2022-09-17T10:27:42.425650+0000","last_became_peered":"2022-09-17T10:27:42.425650+0000","last_unstale":"2022-09-17T10:27:46.823937+0000","last_undegraded":"2022-09-17T10:27:46.823937+0000","last_fullsized":"2022-09-17T10:27:46.823937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823053+0000","last_change":"2022-09-17T10:27:42.807915+0000","last_active":"2022-09-17T10:27:46.823053+0000","last_peered":"2022-09-17T10:27:46.823053+0000","last_clean":"2022-09-17T10:27:46.823053+0000","last_became_active":"2022-09-17T10:27:42.807621+0000","last_became_peered":"2022-09-17T10:27:42.807621+0000","last_unstale":"2022-09-17T10:27:46.823053+0000","last_undegraded":"2022-09-17T10:27:46.823053+0000","last_fullsized":"2022-09-17T10:27:46.823053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832588+0000","last_change":"2022-09-17T10:27:42.418946+0000","last_active":"2022-09-17T10:27:46.832588+0000","last_peered":"2022-09-17T10:27:46.832588+0000","last_clean":"2022-09-17T10:27:46.832588+0000","last_became_active":"2022-09-17T10:27:42.418576+0000","last_became_peered":"2022-09-17T10:27:42.418576+0000","last_unstale":"2022-09-17T10:27:46.832588+0000","last_undegraded":"2022-09-17T10:27:46.832588+0000","last_fullsized":"2022-09-17T10:27:46.832588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824054+0000","last_change":"2022-09-17T10:27:42.817091+0000","last_active":"2022-09-17T10:27:46.824054+0000","last_peered":"2022-09-17T10:27:46.824054+0000","last_clean":"2022-09-17T10:27:46.824054+0000","last_became_active":"2022-09-17T10:27:42.816783+0000","last_became_peered":"2022-09-17T10:27:42.816783+0000","last_unstale":"2022-09-17T10:27:46.824054+0000","last_undegraded":"2022-09-17T10:27:46.824054+0000","last_fullsized":"2022-09-17T10:27:46.824054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879369+0000","last_change":"2022-09-17T10:27:46.878071+0000","last_active":"2022-09-17T10:27:46.879369+0000","last_peered":"2022-09-17T10:27:46.879369+0000","last_clean":"2022-09-17T10:27:46.879369+0000","last_became_active":"2022-09-17T10:27:46.877621+0000","last_became_peered":"2022-09-17T10:27:46.877621+0000","last_unstale":"2022-09-17T10:27:46.879369+0000","last_undegraded":"2022-09-17T10:27:46.879369+0000","last_fullsized":"2022-09-17T10:27:46.879369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":161829,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":164234,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":8,"up_from":17,"seq":73014444039,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":161897,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":161219,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":6,"up_from":17,"seq":73014444038,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":162361,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444039,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":161233,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":161233,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":4,"up_from":17,"seq":73014444040,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5392,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366448,"statfs":{"total":96636764160,"available":96631242752,"internally_reserved":0,"allocated":335872,"data_stored":164268,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-09-17T10:28:01.478 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-09-17T10:28:01.478 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-09-17T10:28:01.479 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-09-17T10:28:01.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-09-17T10:28:01.480 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-09-17T10:28:01.597 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.595+0000 7f190a38a700 1 Processor -- start 2022-09-17T10:28:01.598 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.595+0000 7f190a38a700 1 -- start start 2022-09-17T10:28:01.600 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f190a38a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19041787a0 0x7f19040c8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.601 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f190a38a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1904180130 0x7f190417e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.601 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f190a38a700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19040c9fd0 con 0x7f19041783c0 2022-09-17T10:28:01.601 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f190a38a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19040c8e50 con 0x7f19041787a0 2022-09-17T10:28:01.602 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f190a38a700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19040c90e0 con 0x7f1904180130 2022-09-17T10:28:01.602 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f19037fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19041787a0 0x7f19040c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.602 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f19037fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19041787a0 0x7f19040c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42874/0 (socket says 172.21.15.62:42874) 2022-09-17T10:28:01.602 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f19037fe700 1 -- 172.21.15.62:0/2929875348 learned_addr learned my addr 172.21.15.62:0/2929875348 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:01.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f1908927700 1 --2- 172.21.15.62:0/2929875348 >> v2:172.21.15.93:3300/0 conn(0x7f1904180130 0x7f190417e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f19037fe700 1 -- 172.21.15.62:0/2929875348 >> v2:172.21.15.93:3300/0 conn(0x7f1904180130 msgr2=0x7f190417e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:01.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f19037fe700 1 --2- 172.21.15.62:0/2929875348 >> v2:172.21.15.93:3300/0 conn(0x7f1904180130 0x7f190417e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f19037fe700 1 -- 172.21.15.62:0/2929875348 >> v1:172.21.15.93:6789/0 conn(0x7f19041783c0 legacy=0x7f190417fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:01.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f19037fe700 1 -- 172.21.15.62:0/2929875348 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040c93c0 con 0x7f19041787a0 2022-09-17T10:28:01.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f1908927700 1 --2- 172.21.15.62:0/2929875348 >> v2:172.21.15.93:3300/0 conn(0x7f1904180130 0x7f190417e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:01.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f19037fe700 1 --2- 172.21.15.62:0/2929875348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f19040c8960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f19040c3bc0 tx=0x7f18f40090f0).ready entity=mon.0 client_cookie=380ac9ea38721a12 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:01.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f1902ffd700 1 -- 172.21.15.62:0/2929875348 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400b5a0 con 0x7f19041787a0 2022-09-17T10:28:01.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f1902ffd700 1 -- 172.21.15.62:0/2929875348 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400b700 con 0x7f19041787a0 2022-09-17T10:28:01.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.597+0000 7f1902ffd700 1 -- 172.21.15.62:0/2929875348 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400ba80 con 0x7f19041787a0 2022-09-17T10:28:01.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.598+0000 7f190a38a700 1 -- 172.21.15.62:0/2929875348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 msgr2=0x7f19040c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.598+0000 7f190a38a700 1 --2- 172.21.15.62:0/2929875348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f19040c8960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f19040c3bc0 tx=0x7f18f40090f0).stop 2022-09-17T10:28:01.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.598+0000 7f190a38a700 1 -- 172.21.15.62:0/2929875348 shutdown_connections 2022-09-17T10:28:01.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.598+0000 7f190a38a700 1 --2- 172.21.15.62:0/2929875348 >> v2:172.21.15.93:3300/0 conn(0x7f1904180130 0x7f190417e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.598+0000 7f190a38a700 1 --2- 172.21.15.62:0/2929875348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f19040c8960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.598+0000 7f190a38a700 1 -- 172.21.15.62:0/2929875348 >> 172.21.15.62:0/2929875348 conn(0x7f19040eeea0 msgr2=0x7f190405d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:01.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.598+0000 7f190a38a700 1 -- 172.21.15.62:0/2929875348 shutdown_connections 2022-09-17T10:28:01.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.598+0000 7f190a38a700 1 -- 172.21.15.62:0/2929875348 wait complete. 2022-09-17T10:28:01.610 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.599+0000 7f190a38a700 1 Processor -- start 2022-09-17T10:28:01.610 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.600+0000 7f190a38a700 1 -- start start 2022-09-17T10:28:01.611 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.600+0000 7f190a38a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19041783c0 0x7f19041759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.600+0000 7f190a38a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f1904170d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.600+0000 7f190a38a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1904180130 0x7f1904171280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.600+0000 7f190a38a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19040e6a30 con 0x7f19041787a0 2022-09-17T10:28:01.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.600+0000 7f190a38a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904176fa0 con 0x7f1904180130 2022-09-17T10:28:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.600+0000 7f190a38a700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904176420 con 0x7f19041783c0 2022-09-17T10:28:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f1904170d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f1904170d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42888/0 (socket says 172.21.15.62:42888) 2022-09-17T10:28:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 -- 172.21.15.62:0/2115075910 learned_addr learned my addr 172.21.15.62:0/2115075910 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f1908927700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1904180130 0x7f1904171280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f1903fff700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19041783c0 0x7f19041759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 -- 172.21.15.62:0/2115075910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19041783c0 msgr2=0x7f19041759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19041783c0 0x7f19041759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 -- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1904180130 msgr2=0x7f1904171280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1904180130 0x7f1904171280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 -- 172.21.15.62:0/2115075910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4009370 con 0x7f19041787a0 2022-09-17T10:28:01.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f1908927700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1904180130 0x7f1904171280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:01.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f19037fe700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f1904170d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f18f4011000 tx=0x7f18f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:01.616 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f18ebfff700 1 -- 172.21.15.62:0/2115075910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400ba80 con 0x7f19041787a0 2022-09-17T10:28:01.616 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f18ebfff700 1 -- 172.21.15.62:0/2115075910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f4000c90 con 0x7f19041787a0 2022-09-17T10:28:01.616 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1904176700 con 0x7f19041787a0 2022-09-17T10:28:01.616 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f18ebfff700 1 -- 172.21.15.62:0/2115075910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f401c670 con 0x7f19041787a0 2022-09-17T10:28:01.616 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.601+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1904176cc0 con 0x7f19041787a0 2022-09-17T10:28:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.602+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19040e6bc0 con 0x7f19041787a0 2022-09-17T10:28:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.603+0000 7f18ebfff700 1 -- 172.21.15.62:0/2115075910 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f18f402c070 con 0x7f19041787a0 2022-09-17T10:28:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.604+0000 7f18ebfff700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f18e408ba40 0x7f18e408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.604+0000 7f18ebfff700 1 -- 172.21.15.62:0/2115075910 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f18f40b2a60 con 0x7f19041787a0 2022-09-17T10:28:01.618 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.604+0000 7f1903fff700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f18e408ba40 0x7f18e408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:01.618 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.605+0000 7f1903fff700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f18e408ba40 0x7f18e408df00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f18f80036e0 tx=0x7f18f8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.607+0000 7f18ebfff700 1 -- 172.21.15.62:0/2115075910 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f18f4083720 con 0x7f19041787a0 2022-09-17T10:28:01.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.823+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f190406bf40 con 0x7f19041787a0 2022-09-17T10:28:01.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.827+0000 7f18ebfff700 1 -- 172.21.15.62:0/2115075910 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+221089 (secure 0 0 0) 0x7f18f402a020 con 0x7f19041787a0 2022-09-17T10:28:01.833 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:01.835 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f18e408ba40 msgr2=0x7f18e408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.835 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f18e408ba40 0x7f18e408df00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f18f80036e0 tx=0x7f18f8009040).stop 2022-09-17T10:28:01.836 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 msgr2=0x7f1904170d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:01.836 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f1904170d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f18f4011000 tx=0x7f18f4015000).stop 2022-09-17T10:28:01.836 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 shutdown_connections 2022-09-17T10:28:01.836 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f18e408ba40 0x7f18e408df00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1904180130 0x7f1904171280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19041783c0 0x7f19041759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 --2- 172.21.15.62:0/2115075910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19041787a0 0x7f1904170d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:01.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 >> 172.21.15.62:0/2115075910 conn(0x7f19040eeea0 msgr2=0x7f1904172060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:01.838 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 shutdown_connections 2022-09-17T10:28:01.838 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:01.830+0000 7f190a38a700 1 -- 172.21.15.62:0/2115075910 wait complete. 2022-09-17T10:28:01.845 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":4,"active_gid":4114,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":81423},{"type":"v1","addr":"172.21.15.93:6833","nonce":81423}]},"active_addr":"172.21.15.93:6833/81423","active_change":"2022-09-17T10:27:26.868252+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4106,"name":"z","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":641404612}]},{"addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":3985318548}]}]}} 2022-09-17T10:28:01.852 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-09-17T10:28:01.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-09-17T10:28:01.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:28:02.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.003+0000 7f4022816700 1 Processor -- start 2022-09-17T10:28:02.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.003+0000 7f4022816700 1 -- start start 2022-09-17T10:28:02.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f4022816700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f401c1751b0 0x7f401c180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f4022816700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f401c0ef650 0x7f401c0efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f4022816700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c0c6dd0 con 0x7f401c175590 2022-09-17T10:28:02.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f4022816700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c0f10e0 con 0x7f401c1751b0 2022-09-17T10:28:02.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f4022816700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c1801e0 con 0x7f401c0ef650 2022-09-17T10:28:02.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f401bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f401c1751b0 0x7f401c180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f401bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f401c1751b0 0x7f401c180670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42890/0 (socket says 172.21.15.62:42890) 2022-09-17T10:28:02.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f401bfff700 1 -- 172.21.15.62:0/3605589011 learned_addr learned my addr 172.21.15.62:0/3605589011 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:02.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f4020db3700 1 --2- 172.21.15.62:0/3605589011 >> v2:172.21.15.93:3300/0 conn(0x7f401c0ef650 0x7f401c0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f401bfff700 1 -- 172.21.15.62:0/3605589011 >> v2:172.21.15.93:3300/0 conn(0x7f401c0ef650 msgr2=0x7f401c0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:02.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f401bfff700 1 --2- 172.21.15.62:0/3605589011 >> v2:172.21.15.93:3300/0 conn(0x7f401c0ef650 0x7f401c0efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f401bfff700 1 -- 172.21.15.62:0/3605589011 >> v1:172.21.15.159:6789/0 conn(0x7f401c175590 legacy=0x7f401c180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f401bfff700 1 -- 172.21.15.62:0/3605589011 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c0f0840 con 0x7f401c1751b0 2022-09-17T10:28:02.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f4020db3700 1 --2- 172.21.15.62:0/3605589011 >> v2:172.21.15.93:3300/0 conn(0x7f401c0ef650 0x7f401c0efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.004+0000 7f401bfff700 1 --2- 172.21.15.62:0/3605589011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c1751b0 0x7f401c180670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f401c088650 tx=0x7f400c0090f0).ready entity=mon.0 client_cookie=9df236d79a16cfff server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f401affd700 1 -- 172.21.15.62:0/3605589011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00b600 con 0x7f401c1751b0 2022-09-17T10:28:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f401affd700 1 -- 172.21.15.62:0/3605589011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c00b760 con 0x7f401c1751b0 2022-09-17T10:28:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f401affd700 1 -- 172.21.15.62:0/3605589011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00bb00 con 0x7f401c1751b0 2022-09-17T10:28:02.016 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f4022816700 1 -- 172.21.15.62:0/3605589011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c1751b0 msgr2=0x7f401c180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f4022816700 1 --2- 172.21.15.62:0/3605589011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c1751b0 0x7f401c180670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f401c088650 tx=0x7f400c0090f0).stop 2022-09-17T10:28:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f4022816700 1 -- 172.21.15.62:0/3605589011 shutdown_connections 2022-09-17T10:28:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f4022816700 1 --2- 172.21.15.62:0/3605589011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c1751b0 0x7f401c180670 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f4022816700 1 --2- 172.21.15.62:0/3605589011 >> v2:172.21.15.93:3300/0 conn(0x7f401c0ef650 0x7f401c0efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f4022816700 1 -- 172.21.15.62:0/3605589011 >> 172.21.15.62:0/3605589011 conn(0x7f401c06a170 msgr2=0x7f401c0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f4022816700 1 -- 172.21.15.62:0/3605589011 shutdown_connections 2022-09-17T10:28:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.005+0000 7f4022816700 1 -- 172.21.15.62:0/3605589011 wait complete. 2022-09-17T10:28:02.018 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.007+0000 7f4022816700 1 Processor -- start 2022-09-17T10:28:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.007+0000 7f4022816700 1 -- start start 2022-09-17T10:28:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4022816700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c0ef650 0x7f401c063600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4022816700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f401c1751b0 0x7f401c17d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4022816700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c175590 0x7f401c16d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4022816700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c18f2b0 con 0x7f401c175590 2022-09-17T10:28:02.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4022816700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c1934f0 con 0x7f401c0ef650 2022-09-17T10:28:02.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4022816700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c192970 con 0x7f401c1751b0 2022-09-17T10:28:02.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c175590 0x7f401c16d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c175590 0x7f401c16d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42898/0 (socket says 172.21.15.62:42898) 2022-09-17T10:28:02.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 -- 172.21.15.62:0/1725445094 learned_addr learned my addr 172.21.15.62:0/1725445094 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:02.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f401bfff700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c0ef650 0x7f401c063600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f401b7fe700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f401c1751b0 0x7f401c17d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 -- 172.21.15.62:0/1725445094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f401c1751b0 msgr2=0x7f401c17d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f401c1751b0 0x7f401c17d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 -- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c0ef650 msgr2=0x7f401c063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c0ef650 0x7f401c063600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 -- 172.21.15.62:0/1725445094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c009370 con 0x7f401c175590 2022-09-17T10:28:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.008+0000 7f4020db3700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c175590 0x7f401c16d1b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f401400a380 tx=0x7f4014007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.009+0000 7f4003fff700 1 -- 172.21.15.62:0/1725445094 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014016470 con 0x7f401c175590 2022-09-17T10:28:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.009+0000 7f4003fff700 1 -- 172.21.15.62:0/1725445094 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40140165d0 con 0x7f401c175590 2022-09-17T10:28:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.009+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c192c50 con 0x7f401c175590 2022-09-17T10:28:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.009+0000 7f4003fff700 1 -- 172.21.15.62:0/1725445094 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014016950 con 0x7f401c175590 2022-09-17T10:28:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.009+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c193210 con 0x7f401c175590 2022-09-17T10:28:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.009+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c06bf40 con 0x7f401c175590 2022-09-17T10:28:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.010+0000 7f4003fff700 1 -- 172.21.15.62:0/1725445094 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f401400d440 con 0x7f401c175590 2022-09-17T10:28:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.011+0000 7f4003fff700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3ffc08ba10 0x7f3ffc08ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.011+0000 7f4003fff700 1 -- 172.21.15.62:0/1725445094 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f40140b1a00 con 0x7f401c175590 2022-09-17T10:28:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.011+0000 7f401bfff700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3ffc08ba10 0x7f3ffc08ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.012+0000 7f401bfff700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3ffc08ba10 0x7f3ffc08ded0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f400c009fd0 tx=0x7f400c017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.015+0000 7f4003fff700 1 -- 172.21.15.62:0/1725445094 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f40140826c0 con 0x7f401c175590 2022-09-17T10:28:02.191 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.189+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f401c0f0b20 con 0x7f401c175590 2022-09-17T10:28:02.192 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.190+0000 7f4003fff700 1 -- 172.21.15.62:0/1725445094 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7f4014085ce0 con 0x7f401c175590 2022-09-17T10:28:02.193 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:02.193 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:28:02.195 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3ffc08ba10 msgr2=0x7f3ffc08ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.195 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3ffc08ba10 0x7f3ffc08ded0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f400c009fd0 tx=0x7f400c017000).stop 2022-09-17T10:28:02.196 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c175590 msgr2=0x7f401c16d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.196 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c175590 0x7f401c16d1b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f401400a380 tx=0x7f4014007900).stop 2022-09-17T10:28:02.196 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 shutdown_connections 2022-09-17T10:28:02.196 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3ffc08ba10 0x7f3ffc08ded0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.197 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c0ef650 0x7f401c063600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.197 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f401c175590 0x7f401c16d1b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.197 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 --2- 172.21.15.62:0/1725445094 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f401c1751b0 0x7f401c17d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.197 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 >> 172.21.15.62:0/1725445094 conn(0x7f401c06a170 msgr2=0x7f401c181570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.198 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 shutdown_connections 2022-09-17T10:28:02.198 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.192+0000 7f4022816700 1 -- 172.21.15.62:0/1725445094 wait complete. 2022-09-17T10:28:02.207 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-09-17T10:28:02.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:28:02.326 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.323+0000 7f46c21a5700 1 Processor -- start 2022-09-17T10:28:02.326 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.323+0000 7f46c21a5700 1 -- start start 2022-09-17T10:28:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.324+0000 7f46c21a5700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f46bc175590 0x7f46bc180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.324+0000 7f46c21a5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc0c6dd0 con 0x7f46bc0ef650 2022-09-17T10:28:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46c21a5700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc1801e0 con 0x7f46bc1751b0 2022-09-17T10:28:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46c21a5700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46bc0f10e0 con 0x7f46bc175590 2022-09-17T10:28:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46bbfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f46bc0ef650 0x7f46bc0efa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53122/0 (socket says 172.21.15.62:53122) 2022-09-17T10:28:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46bbfff700 1 -- 172.21.15.62:0/693575639 learned_addr learned my addr 172.21.15.62:0/693575639 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46baffd700 1 --2- 172.21.15.62:0/693575639 >> v2:172.21.15.159:3300/0 conn(0x7f46bc175590 0x7f46bc180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46169281 0 0) 0x7f46bc0c6dd0 con 0x7f46bc0ef650 2022-09-17T10:28:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a80033f0 con 0x7f46bc0ef650 2022-09-17T10:28:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357434022 0 0) 0x7f46bc1801e0 con 0x7f46bc1751b0 2022-09-17T10:28:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46bc0c6dd0 con 0x7f46bc1751b0 2022-09-17T10:28:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 451551565 0 0) 0x7f46a80033f0 con 0x7f46bc0ef650 2022-09-17T10:28:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 >> v2:172.21.15.159:3300/0 conn(0x7f46bc175590 msgr2=0x7f46bc180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 --2- 172.21.15.62:0/693575639 >> v2:172.21.15.159:3300/0 conn(0x7f46bc175590 0x7f46bc180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 >> v1:172.21.15.93:6789/0 conn(0x7f46bc1751b0 legacy=0x7f46bc180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0f0840 con 0x7f46bc0ef650 2022-09-17T10:28:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f46b40017f0 con 0x7f46bc0ef650 2022-09-17T10:28:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 >> v1:172.21.15.62:6789/0 conn(0x7f46bc0ef650 legacy=0x7f46bc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46a8003ac0 0x7f46a8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8004690 0x7f46a8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46a8005070 0x7f46a800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0f10e0 con 0x7f46a8005070 2022-09-17T10:28:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a800c010 con 0x7f46a8004690 2022-09-17T10:28:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a800c1d0 con 0x7f46a8003ac0 2022-09-17T10:28:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46bbfff700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46a8005070 0x7f46a800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46bb7fe700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46a8003ac0 0x7f46a8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.325+0000 7f46baffd700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8004690 0x7f46a8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46bbfff700 1 -- 172.21.15.62:0/693575639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46a8003ac0 msgr2=0x7f46a8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46bbfff700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46a8003ac0 0x7f46a8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46bbfff700 1 -- 172.21.15.62:0/693575639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8004690 msgr2=0x7f46a8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46bbfff700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8004690 0x7f46a8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46bbfff700 1 -- 172.21.15.62:0/693575639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80033f0 con 0x7f46a8005070 2022-09-17T10:28:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46bbfff700 1 -- 172.21.15.62:0/693575639 reap_dead start 2022-09-17T10:28:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46bbfff700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46a8005070 0x7f46a800b8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f46b400c5c0 tx=0x7f46b4007f40).ready entity=mon.0 client_cookie=4b990144a5e1bf71 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400cdc0 con 0x7f46a8005070 2022-09-17T10:28:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4005b20 con 0x7f46a8005070 2022-09-17T10:28:02.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46ba7fc700 1 -- 172.21.15.62:0/693575639 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4005ea0 con 0x7f46a8005070 2022-09-17T10:28:02.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46c21a5700 1 -- 172.21.15.62:0/693575639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46a8005070 msgr2=0x7f46a800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46c21a5700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46a8005070 0x7f46a800b8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f46b400c5c0 tx=0x7f46b4007f40).stop 2022-09-17T10:28:02.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46c21a5700 1 -- 172.21.15.62:0/693575639 shutdown_connections 2022-09-17T10:28:02.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46c21a5700 1 --2- 172.21.15.62:0/693575639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46a8005070 0x7f46a800b8e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.326+0000 7f46c21a5700 1 -- 172.21.15.62:0/693575639 >> 172.21.15.62:0/693575639 conn(0x7f46bc06a170 msgr2=0x7f46bc0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.327+0000 7f46c21a5700 1 -- 172.21.15.62:0/693575639 shutdown_connections 2022-09-17T10:28:02.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.327+0000 7f46c21a5700 1 -- 172.21.15.62:0/693575639 wait complete. 2022-09-17T10:28:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.328+0000 7f46c21a5700 1 Processor -- start 2022-09-17T10:28:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.328+0000 7f46c21a5700 1 -- start start 2022-09-17T10:28:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46c21a5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8005070 0x7f46bc063ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46c21a5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46bc063fc0 0x7f46bc16e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46c21a5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46bc16ea50 0x7f46bc178f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46c21a5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc087d00 con 0x7f46bc063fc0 2022-09-17T10:28:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46c21a5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc087870 con 0x7f46a8005070 2022-09-17T10:28:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46c21a5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc086c60 con 0x7f46bc16ea50 2022-09-17T10:28:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46baffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46bc063fc0 0x7f46bc16e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46baffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46bc063fc0 0x7f46bc16e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42914/0 (socket says 172.21.15.62:42914) 2022-09-17T10:28:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46baffd700 1 -- 172.21.15.62:0/1373507179 learned_addr learned my addr 172.21.15.62:0/1373507179 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46baffd700 1 -- 172.21.15.62:0/1373507179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46bc16ea50 msgr2=0x7f46bc178f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46baffd700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46bc16ea50 0x7f46bc178f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46baffd700 1 -- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8005070 msgr2=0x7f46bc063ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46bb7fe700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8005070 0x7f46bc063ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46baffd700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8005070 0x7f46bc063ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.329+0000 7f46baffd700 1 -- 172.21.15.62:0/1373507179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc086f40 con 0x7f46bc063fc0 2022-09-17T10:28:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.330+0000 7f46baffd700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46bc063fc0 0x7f46bc16e560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f46b00119f0 tx=0x7f46b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.330+0000 7f46a37fe700 1 -- 172.21.15.62:0/1373507179 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000f940 con 0x7f46bc063fc0 2022-09-17T10:28:02.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.330+0000 7f46a37fe700 1 -- 172.21.15.62:0/1373507179 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000faa0 con 0x7f46bc063fc0 2022-09-17T10:28:02.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.330+0000 7f46a37fe700 1 -- 172.21.15.62:0/1373507179 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000fe20 con 0x7f46bc063fc0 2022-09-17T10:28:02.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.330+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc087220 con 0x7f46bc063fc0 2022-09-17T10:28:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.330+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc0f04b0 con 0x7f46bc063fc0 2022-09-17T10:28:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.331+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46bc0876c0 con 0x7f46bc063fc0 2022-09-17T10:28:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.332+0000 7f46a37fe700 1 -- 172.21.15.62:0/1373507179 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f46b0024070 con 0x7f46bc063fc0 2022-09-17T10:28:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.332+0000 7f46a37fe700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f469c08ba40 0x7f469c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.332+0000 7f46a37fe700 1 -- 172.21.15.62:0/1373507179 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f46b00b17e0 con 0x7f46bc063fc0 2022-09-17T10:28:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.332+0000 7f46bb7fe700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f469c08ba40 0x7f469c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.333+0000 7f46bb7fe700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f469c08ba40 0x7f469c08df00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f46ac000c00 tx=0x7f46ac009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.335+0000 7f46a37fe700 1 -- 172.21.15.62:0/1373507179 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f46b00824a0 con 0x7f46bc063fc0 2022-09-17T10:28:02.508 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.506+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46bc06bf40 con 0x7f46bc063fc0 2022-09-17T10:28:02.509 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.507+0000 7f46a37fe700 1 -- 172.21.15.62:0/1373507179 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7f46b0085ac0 con 0x7f46bc063fc0 2022-09-17T10:28:02.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:02.512 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:28:02.514 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f469c08ba40 msgr2=0x7f469c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.515 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f469c08ba40 0x7f469c08df00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f46ac000c00 tx=0x7f46ac009040).stop 2022-09-17T10:28:02.515 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46bc063fc0 msgr2=0x7f46bc16e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.516 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46bc063fc0 0x7f46bc16e560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f46b00119f0 tx=0x7f46b0009060).stop 2022-09-17T10:28:02.516 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 shutdown_connections 2022-09-17T10:28:02.517 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f469c08ba40 0x7f469c08df00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.517 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46a8005070 0x7f46bc063ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.517 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46bc16ea50 0x7f46bc178f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:02.518 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 --2- 172.21.15.62:0/1373507179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46bc063fc0 0x7f46bc16e560 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.518 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 >> 172.21.15.62:0/1373507179 conn(0x7f46bc06a170 msgr2=0x7f46bc084520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 shutdown_connections 2022-09-17T10:28:02.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.509+0000 7f46c21a5700 1 -- 172.21.15.62:0/1373507179 wait complete. 2022-09-17T10:28:02.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-09-17T10:28:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.640+0000 7f3243e2b700 1 Processor -- start 2022-09-17T10:28:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.640+0000 7f3243e2b700 1 -- start start 2022-09-17T10:28:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f3243e2b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f323c1751b0 0x7f323c180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f3243e2b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f323c175590 0x7f323c180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f3243e2b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c0c6dd0 con 0x7f323c181050 2022-09-17T10:28:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f3243e2b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c0f10e0 con 0x7f323c175590 2022-09-17T10:28:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f3243e2b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c0f0660 con 0x7f323c1751b0 2022-09-17T10:28:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f32413c6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f323c175590 0x7f323c180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f32423c8700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f323c181050 0x7f323c181dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53126/0 (socket says 172.21.15.62:53126) 2022-09-17T10:28:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f32423c8700 1 -- 172.21.15.62:0/1260693195 learned_addr learned my addr 172.21.15.62:0/1260693195 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.641+0000 7f3241bc7700 1 --2- 172.21.15.62:0/1260693195 >> v2:172.21.15.93:3300/0 conn(0x7f323c1751b0 0x7f323c180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f32413c6700 1 -- 172.21.15.62:0/1260693195 >> v2:172.21.15.93:3300/0 conn(0x7f323c1751b0 msgr2=0x7f323c180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f32413c6700 1 --2- 172.21.15.62:0/1260693195 >> v2:172.21.15.93:3300/0 conn(0x7f323c1751b0 0x7f323c180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f32413c6700 1 -- 172.21.15.62:0/1260693195 >> v1:172.21.15.62:6789/0 conn(0x7f323c181050 legacy=0x7f323c181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f32413c6700 1 -- 172.21.15.62:0/1260693195 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c1801e0 con 0x7f323c175590 2022-09-17T10:28:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3240bc5700 1 -- 172.21.15.62:0/1260693195 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434693554 0 0) 0x7f323c0c6dd0 con 0x7f323c181050 2022-09-17T10:28:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f32413c6700 1 --2- 172.21.15.62:0/1260693195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c175590 0x7f323c180b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f323c088880 tx=0x7f3230009060).ready entity=mon.0 client_cookie=f439bf6a25a85f4a server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3240bc5700 1 -- 172.21.15.62:0/1260693195 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300090d0 con 0x7f323c175590 2022-09-17T10:28:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3240bc5700 1 -- 172.21.15.62:0/1260693195 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323000b580 con 0x7f323c175590 2022-09-17T10:28:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3240bc5700 1 -- 172.21.15.62:0/1260693195 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000b900 con 0x7f323c175590 2022-09-17T10:28:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3243e2b700 1 -- 172.21.15.62:0/1260693195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c175590 msgr2=0x7f323c180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3243e2b700 1 --2- 172.21.15.62:0/1260693195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c175590 0x7f323c180b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f323c088880 tx=0x7f3230009060).stop 2022-09-17T10:28:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3243e2b700 1 -- 172.21.15.62:0/1260693195 shutdown_connections 2022-09-17T10:28:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3243e2b700 1 --2- 172.21.15.62:0/1260693195 >> v2:172.21.15.93:3300/0 conn(0x7f323c1751b0 0x7f323c180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3243e2b700 1 --2- 172.21.15.62:0/1260693195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c175590 0x7f323c180b60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3243e2b700 1 -- 172.21.15.62:0/1260693195 >> 172.21.15.62:0/1260693195 conn(0x7f323c06a170 msgr2=0x7f323c0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3243e2b700 1 -- 172.21.15.62:0/1260693195 shutdown_connections 2022-09-17T10:28:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.642+0000 7f3243e2b700 1 -- 172.21.15.62:0/1260693195 wait complete. 2022-09-17T10:28:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.644+0000 7f3243e2b700 1 Processor -- start 2022-09-17T10:28:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.644+0000 7f3243e2b700 1 -- start start 2022-09-17T10:28:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3243e2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c1751b0 0x7f323c16fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3243e2b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323c175590 0x7f323c16e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3243e2b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f323c181050 0x7f323c190ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3243e2b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c190620 con 0x7f323c1751b0 2022-09-17T10:28:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3243e2b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c17d6b0 con 0x7f323c175590 2022-09-17T10:28:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3243e2b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c17d990 con 0x7f323c181050 2022-09-17T10:28:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c1751b0 0x7f323c16fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c1751b0 0x7f323c16fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42946/0 (socket says 172.21.15.62:42946) 2022-09-17T10:28:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 -- 172.21.15.62:0/2159291676 learned_addr learned my addr 172.21.15.62:0/2159291676 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f32413c6700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323c175590 0x7f323c16e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f32423c8700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f323c181050 0x7f323c190ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 -- 172.21.15.62:0/2159291676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f323c181050 msgr2=0x7f323c190ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f323c181050 0x7f323c190ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 -- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323c175590 msgr2=0x7f323c16e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323c175590 0x7f323c16e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 -- 172.21.15.62:0/2159291676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32300092a0 con 0x7f323c1751b0 2022-09-17T10:28:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f32413c6700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323c175590 0x7f323c16e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3241bc7700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c1751b0 0x7f323c16fbb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f323400d890 tx=0x7f3234008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.645+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340125f0 con 0x7f323c1751b0 2022-09-17T10:28:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.646+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234012750 con 0x7f323c1751b0 2022-09-17T10:28:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.646+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c18ffd0 con 0x7f323c1751b0 2022-09-17T10:28:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.646+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234012ad0 con 0x7f323c1751b0 2022-09-17T10:28:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.646+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c1700a0 con 0x7f323c1751b0 2022-09-17T10:28:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.646+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f323c06bf40 con 0x7f323c1751b0 2022-09-17T10:28:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.647+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3234013480 con 0x7f323c1751b0 2022-09-17T10:28:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.648+0000 7f3239ffb700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f321c08ba40 0x7f321c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.648+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f32340b0c40 con 0x7f323c1751b0 2022-09-17T10:28:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.648+0000 7f3239ffb700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.62:6800/81782,v1:172.21.15.62:6801/81782] conn(0x7f321c097420 0x7f321c0998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.648+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 --> [v2:172.21.15.62:6800/81782,v1:172.21.15.62:6801/81782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f321c099f40 con 0x7f321c097420 2022-09-17T10:28:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.648+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32340b51c0 con 0x7f323c1751b0 2022-09-17T10:28:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.648+0000 7f32413c6700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f321c08ba40 0x7f321c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.648+0000 7f32423c8700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.62:6800/81782,v1:172.21.15.62:6801/81782] conn(0x7f321c097420 0x7f321c0998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.648+0000 7f32423c8700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.62:6800/81782,v1:172.21.15.62:6801/81782] conn(0x7f321c097420 0x7f321c0998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.649+0000 7f32413c6700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f321c08ba40 0x7f321c08df00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f3230009fd0 tx=0x7f3230017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.649+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 <== osd.0 v2:172.21.15.62:6800/81782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f321c099f40 con 0x7f321c097420 2022-09-17T10:28:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 --> [v2:172.21.15.62:6800/81782,v1:172.21.15.62:6801/81782] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f323c190760 con 0x7f321c097420 2022-09-17T10:28:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3239ffb700 1 -- 172.21.15.62:0/2159291676 <== osd.0 v2:172.21.15.62:6800/81782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f322c001d90 con 0x7f321c097420 2022-09-17T10:28:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 >> [v2:172.21.15.62:6800/81782,v1:172.21.15.62:6801/81782] conn(0x7f321c097420 msgr2=0x7f321c0998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.62:6800/81782,v1:172.21.15.62:6801/81782] conn(0x7f321c097420 0x7f321c0998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f321c08ba40 msgr2=0x7f321c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f321c08ba40 0x7f321c08df00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f3230009fd0 tx=0x7f3230017000).stop 2022-09-17T10:28:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c1751b0 msgr2=0x7f323c16fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 --2- 172.21.15.62:0/2159291676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f323c1751b0 0x7f323c16fbb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f323400d890 tx=0x7f3234008040).stop 2022-09-17T10:28:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f32423c8700 1 -- 172.21.15.62:0/2159291676 reap_dead start 2022-09-17T10:28:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 shutdown_connections 2022-09-17T10:28:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 >> 172.21.15.62:0/2159291676 conn(0x7f323c06a170 msgr2=0x7f323c1826c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 shutdown_connections 2022-09-17T10:28:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.664+0000 7f3243e2b700 1 -- 172.21.15.62:0/2159291676 wait complete. 2022-09-17T10:28:02.677 INFO:teuthology.orchestra.run.smithi062.stdout:73014444040 2022-09-17T10:28:02.678 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-09-17T10:28:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.793+0000 7f2738656700 1 Processor -- start 2022-09-17T10:28:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.793+0000 7f2738656700 1 -- start start 2022-09-17T10:28:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.794+0000 7f2738656700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2730062950 0x7f2730062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.794+0000 7f2738656700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300c6dd0 con 0x7f27301751b0 2022-09-17T10:28:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.794+0000 7f2738656700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300642c0 con 0x7f2730175590 2022-09-17T10:28:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.794+0000 7f2738656700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300f10e0 con 0x7f2730062950 2022-09-17T10:28:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f27363f2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f27301751b0 0x7f2730180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53128/0 (socket says 172.21.15.62:53128) 2022-09-17T10:28:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f27363f2700 1 -- 172.21.15.62:0/3117397216 learned_addr learned my addr 172.21.15.62:0/3117397216 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f2736bf3700 1 --2- 172.21.15.62:0/3117397216 >> v2:172.21.15.159:3300/0 conn(0x7f2730062950 0x7f2730062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f27353f0700 1 -- 172.21.15.62:0/3117397216 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178453212 0 0) 0x7f27300c6dd0 con 0x7f27301751b0 2022-09-17T10:28:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f27353f0700 1 -- 172.21.15.62:0/3117397216 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271c0033f0 con 0x7f27301751b0 2022-09-17T10:28:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f2736bf3700 1 -- 172.21.15.62:0/3117397216 >> v1:172.21.15.93:6789/0 conn(0x7f2730175590 legacy=0x7f2730180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f2736bf3700 1 -- 172.21.15.62:0/3117397216 >> v1:172.21.15.62:6789/0 conn(0x7f27301751b0 legacy=0x7f2730180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f2736bf3700 1 -- 172.21.15.62:0/3117397216 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27301801e0 con 0x7f2730062950 2022-09-17T10:28:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f2736bf3700 1 --2- 172.21.15.62:0/3117397216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2730062950 0x7f2730062dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2720009e60 tx=0x7f2720009780).ready entity=mon.2 client_cookie=711ed3c0f946b511 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f27353f0700 1 -- 172.21.15.62:0/3117397216 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272000e070 con 0x7f2730062950 2022-09-17T10:28:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f27353f0700 1 -- 172.21.15.62:0/3117397216 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272000bb60 con 0x7f2730062950 2022-09-17T10:28:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.795+0000 7f27353f0700 1 -- 172.21.15.62:0/3117397216 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720012410 con 0x7f2730062950 2022-09-17T10:28:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.796+0000 7f2738656700 1 -- 172.21.15.62:0/3117397216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2730062950 msgr2=0x7f2730062dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.796+0000 7f2738656700 1 --2- 172.21.15.62:0/3117397216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2730062950 0x7f2730062dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2720009e60 tx=0x7f2720009780).stop 2022-09-17T10:28:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.796+0000 7f2738656700 1 -- 172.21.15.62:0/3117397216 shutdown_connections 2022-09-17T10:28:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.796+0000 7f2738656700 1 --2- 172.21.15.62:0/3117397216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2730062950 0x7f2730062dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.796+0000 7f2738656700 1 -- 172.21.15.62:0/3117397216 >> 172.21.15.62:0/3117397216 conn(0x7f273006a170 msgr2=0x7f27300f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.796+0000 7f2738656700 1 -- 172.21.15.62:0/3117397216 shutdown_connections 2022-09-17T10:28:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.796+0000 7f2738656700 1 -- 172.21.15.62:0/3117397216 wait complete. 2022-09-17T10:28:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.797+0000 7f2738656700 1 Processor -- start 2022-09-17T10:28:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.797+0000 7f2738656700 1 -- start start 2022-09-17T10:28:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.798+0000 7f2738656700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2730062950 0x7f27301929e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.798+0000 7f2738656700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27301751b0 0x7f2730182200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.798+0000 7f2738656700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2730175590 0x7f2730083e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.798+0000 7f2738656700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300f0660 con 0x7f2730175590 2022-09-17T10:28:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.798+0000 7f2738656700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2730179ea0 con 0x7f2730062950 2022-09-17T10:28:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.798+0000 7f2738656700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2730192ed0 con 0x7f27301751b0 2022-09-17T10:28:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2730175590 0x7f2730083e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2730175590 0x7f2730083e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42960/0 (socket says 172.21.15.62:42960) 2022-09-17T10:28:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 -- 172.21.15.62:0/4099886160 learned_addr learned my addr 172.21.15.62:0/4099886160 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f27363f2700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2730062950 0x7f27301929e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2735bf1700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27301751b0 0x7f2730182200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 -- 172.21.15.62:0/4099886160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27301751b0 msgr2=0x7f2730182200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27301751b0 0x7f2730182200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 -- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2730062950 msgr2=0x7f27301929e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2730062950 0x7f27301929e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 -- 172.21.15.62:0/4099886160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720009a20 con 0x7f2730175590 2022-09-17T10:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2736bf3700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2730175590 0x7f2730083e80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f273017e840 tx=0x7f2730180150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720012410 con 0x7f2730175590 2022-09-17T10:28:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272001d630 con 0x7f2730175590 2022-09-17T10:28:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27301826f0 con 0x7f2730175590 2022-09-17T10:28:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272001d9f0 con 0x7f2730175590 2022-09-17T10:28:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.799+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2730179290 con 0x7f2730175590 2022-09-17T10:28:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.800+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f273006bf40 con 0x7f2730175590 2022-09-17T10:28:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.801+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f272001dd60 con 0x7f2730175590 2022-09-17T10:28:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.801+0000 7f272e7fc700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f271008ba40 0x7f271008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.802+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f27200b34e0 con 0x7f2730175590 2022-09-17T10:28:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.802+0000 7f272e7fc700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6824/81655,v1:172.21.15.93:6825/81655] conn(0x7f27100973a0 0x7f2710099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.802+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 --> [v2:172.21.15.93:6824/81655,v1:172.21.15.93:6825/81655] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2710099ec0 con 0x7f27100973a0 2022-09-17T10:28:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.802+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27200b3850 con 0x7f2730175590 2022-09-17T10:28:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.802+0000 7f27363f2700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f271008ba40 0x7f271008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.802+0000 7f2735bf1700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6824/81655,v1:172.21.15.93:6825/81655] conn(0x7f27100973a0 0x7f2710099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.802+0000 7f27363f2700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f271008ba40 0x7f271008df00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2728005750 tx=0x7f2728009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.802+0000 7f2735bf1700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6824/81655,v1:172.21.15.93:6825/81655] conn(0x7f27100973a0 0x7f2710099840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.803+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 <== osd.1 v2:172.21.15.93:6824/81655 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2710099ec0 con 0x7f27100973a0 2022-09-17T10:28:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.817+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 --> [v2:172.21.15.93:6824/81655,v1:172.21.15.93:6825/81655] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f273017a030 con 0x7f27100973a0 2022-09-17T10:28:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f272e7fc700 1 -- 172.21.15.62:0/4099886160 <== osd.1 v2:172.21.15.93:6824/81655 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f273017a030 con 0x7f27100973a0 2022-09-17T10:28:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6824/81655,v1:172.21.15.93:6825/81655] conn(0x7f27100973a0 msgr2=0x7f2710099840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6824/81655,v1:172.21.15.93:6825/81655] conn(0x7f27100973a0 0x7f2710099840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f271008ba40 msgr2=0x7f271008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f271008ba40 0x7f271008df00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2728005750 tx=0x7f2728009040).stop 2022-09-17T10:28:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2730175590 msgr2=0x7f2730083e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 --2- 172.21.15.62:0/4099886160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2730175590 0x7f2730083e80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f273017e840 tx=0x7f2730180150).stop 2022-09-17T10:28:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2736bf3700 1 -- 172.21.15.62:0/4099886160 reap_dead start 2022-09-17T10:28:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 shutdown_connections 2022-09-17T10:28:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 >> 172.21.15.62:0/4099886160 conn(0x7f273006a170 msgr2=0x7f273017e870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 shutdown_connections 2022-09-17T10:28:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.818+0000 7f2738656700 1 -- 172.21.15.62:0/4099886160 wait complete. 2022-09-17T10:28:02.832 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:02.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-09-17T10:28:02.951 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.949+0000 7f29f0c88700 1 Processor -- start 2022-09-17T10:28:02.952 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.949+0000 7f29f0c88700 1 -- start start 2022-09-17T10:28:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.950+0000 7f29f0c88700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f29ec1751b0 0x7f29ec180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.950+0000 7f29f0c88700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f29ec175590 0x7f29ec180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29f0c88700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec0c6dd0 con 0x7f29ec181050 2022-09-17T10:28:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29f0c88700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0f10e0 con 0x7f29ec1751b0 2022-09-17T10:28:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29f0c88700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0f0660 con 0x7f29ec175590 2022-09-17T10:28:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29ead9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f29ec181050 0x7f29ec181dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53144/0 (socket says 172.21.15.62:53144) 2022-09-17T10:28:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29ead9d700 1 -- 172.21.15.62:0/111286214 learned_addr learned my addr 172.21.15.62:0/111286214 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29e9d9b700 1 --2- 172.21.15.62:0/111286214 >> v2:172.21.15.159:3300/0 conn(0x7f29ec175590 0x7f29ec180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29ea59c700 1 --2- 172.21.15.62:0/111286214 >> v2:172.21.15.93:3300/0 conn(0x7f29ec1751b0 0x7f29ec180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29e959a700 1 -- 172.21.15.62:0/111286214 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642881159 0 0) 0x7f29ec0c6dd0 con 0x7f29ec181050 2022-09-17T10:28:02.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29e959a700 1 -- 172.21.15.62:0/111286214 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29cc0033f0 con 0x7f29ec181050 2022-09-17T10:28:02.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29e9d9b700 1 -- 172.21.15.62:0/111286214 >> v2:172.21.15.93:3300/0 conn(0x7f29ec1751b0 msgr2=0x7f29ec180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:02.957 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29e9d9b700 1 --2- 172.21.15.62:0/111286214 >> v2:172.21.15.93:3300/0 conn(0x7f29ec1751b0 0x7f29ec180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29e9d9b700 1 -- 172.21.15.62:0/111286214 >> v1:172.21.15.62:6789/0 conn(0x7f29ec181050 legacy=0x7f29ec181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29e9d9b700 1 -- 172.21.15.62:0/111286214 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec1801e0 con 0x7f29ec175590 2022-09-17T10:28:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29ea59c700 1 --2- 172.21.15.62:0/111286214 >> v2:172.21.15.93:3300/0 conn(0x7f29ec1751b0 0x7f29ec180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:28:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.951+0000 7f29e9d9b700 1 --2- 172.21.15.62:0/111286214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29ec175590 0x7f29ec180b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f29ec085780 tx=0x7f29d4009060).ready entity=mon.2 client_cookie=2d8aba6c277fd93b server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29e959a700 1 -- 172.21.15.62:0/111286214 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40090d0 con 0x7f29ec175590 2022-09-17T10:28:02.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29e959a700 1 -- 172.21.15.62:0/111286214 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400d4a0 con 0x7f29ec175590 2022-09-17T10:28:02.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29e959a700 1 -- 172.21.15.62:0/111286214 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400d820 con 0x7f29ec175590 2022-09-17T10:28:02.959 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29f0c88700 1 -- 172.21.15.62:0/111286214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29ec175590 msgr2=0x7f29ec180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29f0c88700 1 --2- 172.21.15.62:0/111286214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29ec175590 0x7f29ec180b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f29ec085780 tx=0x7f29d4009060).stop 2022-09-17T10:28:02.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29f0c88700 1 -- 172.21.15.62:0/111286214 shutdown_connections 2022-09-17T10:28:02.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29f0c88700 1 --2- 172.21.15.62:0/111286214 >> v2:172.21.15.93:3300/0 conn(0x7f29ec1751b0 0x7f29ec180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.960 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29f0c88700 1 --2- 172.21.15.62:0/111286214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29ec175590 0x7f29ec180b60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29f0c88700 1 -- 172.21.15.62:0/111286214 >> 172.21.15.62:0/111286214 conn(0x7f29ec06a170 msgr2=0x7f29ec0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29f0c88700 1 -- 172.21.15.62:0/111286214 shutdown_connections 2022-09-17T10:28:02.961 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.952+0000 7f29f0c88700 1 -- 172.21.15.62:0/111286214 wait complete. 2022-09-17T10:28:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.953+0000 7f29f0c88700 1 Processor -- start 2022-09-17T10:28:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.954+0000 7f29f0c88700 1 -- start start 2022-09-17T10:28:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29f0c88700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29ec1751b0 0x7f29ec1843b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29f0c88700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29ec175590 0x7f29ec16fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29f0c88700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29ec181050 0x7f29ec1701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29f0c88700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec175d80 con 0x7f29ec1751b0 2022-09-17T10:28:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29f0c88700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec176060 con 0x7f29ec181050 2022-09-17T10:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29f0c88700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec176340 con 0x7f29ec175590 2022-09-17T10:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29ec1751b0 0x7f29ec1843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29ec1751b0 0x7f29ec1843b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42972/0 (socket says 172.21.15.62:42972) 2022-09-17T10:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 -- 172.21.15.62:0/1781831818 learned_addr learned my addr 172.21.15.62:0/1781831818 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29e9d9b700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29ec175590 0x7f29ec16fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 -- 172.21.15.62:0/1781831818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29ec175590 msgr2=0x7f29ec16fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29ec175590 0x7f29ec16fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 -- 172.21.15.62:0/1781831818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29ec181050 msgr2=0x7f29ec1701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29ec181050 0x7f29ec1701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 -- 172.21.15.62:0/1781831818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009a20 con 0x7f29ec1751b0 2022-09-17T10:28:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29ea59c700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29ec1751b0 0x7f29ec1843b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f29e400c170 tx=0x7f29e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4009d80 con 0x7f29ec1751b0 2022-09-17T10:28:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400f040 con 0x7f29ec1751b0 2022-09-17T10:28:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d40092a0 con 0x7f29ec1751b0 2022-09-17T10:28:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4013400 con 0x7f29ec1751b0 2022-09-17T10:28:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.955+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec176900 con 0x7f29ec1751b0 2022-09-17T10:28:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.956+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29ec18fce0 con 0x7f29ec1751b0 2022-09-17T10:28:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.957+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f29e40137b0 con 0x7f29ec1751b0 2022-09-17T10:28:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.958+0000 7f29e27fc700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f29d008ba40 0x7f29d008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.958+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f29e40b1f70 con 0x7f29ec1751b0 2022-09-17T10:28:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.958+0000 7f29e27fc700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.159:6801/81895,v1:172.21.15.159:6803/81895] conn(0x7f29d0097420 0x7f29d00998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.958+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 --> [v2:172.21.15.159:6801/81895,v1:172.21.15.159:6803/81895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29d0099f40 con 0x7f29d0097420 2022-09-17T10:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.958+0000 7f29e9d9b700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f29d008ba40 0x7f29d008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.958+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29e40b2280 con 0x7f29ec1751b0 2022-09-17T10:28:02.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.958+0000 7f29e9d9b700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f29d008ba40 0x7f29d008df00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f29d4009fd0 tx=0x7f29d4016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.958+0000 7f29ead9d700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.159:6801/81895,v1:172.21.15.159:6803/81895] conn(0x7f29d0097420 0x7f29d00998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:02.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.959+0000 7f29ead9d700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.159:6801/81895,v1:172.21.15.159:6803/81895] conn(0x7f29d0097420 0x7f29d00998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:02.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.960+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 <== osd.2 v2:172.21.15.159:6801/81895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f29d0099f40 con 0x7f29d0097420 2022-09-17T10:28:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.974+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 --> [v2:172.21.15.159:6801/81895,v1:172.21.15.159:6803/81895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29ec1764b0 con 0x7f29d0097420 2022-09-17T10:28:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.974+0000 7f29e27fc700 1 -- 172.21.15.62:0/1781831818 <== osd.2 v2:172.21.15.159:6801/81895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f29ec1764b0 con 0x7f29d0097420 2022-09-17T10:28:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 >> [v2:172.21.15.159:6801/81895,v1:172.21.15.159:6803/81895] conn(0x7f29d0097420 msgr2=0x7f29d00998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.159:6801/81895,v1:172.21.15.159:6803/81895] conn(0x7f29d0097420 0x7f29d00998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f29d008ba40 msgr2=0x7f29d008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f29d008ba40 0x7f29d008df00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f29d4009fd0 tx=0x7f29d4016000).stop 2022-09-17T10:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29ec1751b0 msgr2=0x7f29ec1843b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 --2- 172.21.15.62:0/1781831818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29ec1751b0 0x7f29ec1843b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f29e400c170 tx=0x7f29e400b040).stop 2022-09-17T10:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29ead9d700 1 -- 172.21.15.62:0/1781831818 reap_dead start 2022-09-17T10:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 shutdown_connections 2022-09-17T10:28:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 >> 172.21.15.62:0/1781831818 conn(0x7f29ec06a170 msgr2=0x7f29ec180830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 shutdown_connections 2022-09-17T10:28:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:02.975+0000 7f29f0c88700 1 -- 172.21.15.62:0/1781831818 wait complete. 2022-09-17T10:28:02.988 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:02.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-09-17T10:28:03.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.107+0000 7f0792c70700 1 Processor -- start 2022-09-17T10:28:03.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.107+0000 7f0792c70700 1 -- start start 2022-09-17T10:28:03.112 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f0792c70700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f078c175680 0x7f078c0e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.112 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f0792c70700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c17b1f0 con 0x7f078c1752a0 2022-09-17T10:28:03.112 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f0792c70700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c0e9260 con 0x7f078c179090 2022-09-17T10:28:03.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f0792c70700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c17a670 con 0x7f078c175680 2022-09-17T10:28:03.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f0790a0c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f078c1752a0 0x7f078c0e96f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53152/0 (socket says 172.21.15.62:53152) 2022-09-17T10:28:03.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f078bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f078c175680 0x7f078c0e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f0790a0c700 1 -- 172.21.15.62:0/2482807971 learned_addr learned my addr 172.21.15.62:0/2482807971 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:03.113 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f078bfff700 1 -- 172.21.15.62:0/2482807971 >> v1:172.21.15.93:6789/0 conn(0x7f078c179090 legacy=0x7f078c179540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f078bfff700 1 -- 172.21.15.62:0/2482807971 >> v1:172.21.15.62:6789/0 conn(0x7f078c1752a0 legacy=0x7f078c0e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f078bfff700 1 -- 172.21.15.62:0/2482807971 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c17a950 con 0x7f078c175680 2022-09-17T10:28:03.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.108+0000 7f078bfff700 1 --2- 172.21.15.62:0/2482807971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 0x7f078c0e9e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f077c009760 tx=0x7f077c009060).ready entity=mon.0 client_cookie=9a6f4f7b99dc198 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.114 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f078b7fe700 1 -- 172.21.15.62:0/2482807971 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0090d0 con 0x7f078c175680 2022-09-17T10:28:03.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f078b7fe700 1 -- 172.21.15.62:0/2482807971 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c00b520 con 0x7f078c175680 2022-09-17T10:28:03.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f078b7fe700 1 -- 172.21.15.62:0/2482807971 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c00b8a0 con 0x7f078c175680 2022-09-17T10:28:03.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f0792c70700 1 -- 172.21.15.62:0/2482807971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 msgr2=0x7f078c0e9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.115 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f0792c70700 1 --2- 172.21.15.62:0/2482807971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 0x7f078c0e9e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f077c009760 tx=0x7f077c009060).stop 2022-09-17T10:28:03.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f0792c70700 1 -- 172.21.15.62:0/2482807971 shutdown_connections 2022-09-17T10:28:03.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f0792c70700 1 --2- 172.21.15.62:0/2482807971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 0x7f078c0e9e00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f0792c70700 1 -- 172.21.15.62:0/2482807971 >> 172.21.15.62:0/2482807971 conn(0x7f078c0edc30 msgr2=0x7f078c0ee040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.116 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f0792c70700 1 -- 172.21.15.62:0/2482807971 shutdown_connections 2022-09-17T10:28:03.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.109+0000 7f0792c70700 1 -- 172.21.15.62:0/2482807971 wait complete. 2022-09-17T10:28:03.120 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.111+0000 7f0792c70700 1 Processor -- start 2022-09-17T10:28:03.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.111+0000 7f0792c70700 1 -- start start 2022-09-17T10:28:03.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0792c70700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f078c1752a0 0x7f078c16c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.121 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0792c70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 0x7f078c16c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0792c70700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c179090 0x7f078c191280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0792c70700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0c6760 con 0x7f078c175680 2022-09-17T10:28:03.122 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0792c70700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c190df0 con 0x7f078c1752a0 2022-09-17T10:28:03.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0792c70700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1901e0 con 0x7f078c179090 2022-09-17T10:28:03.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 0x7f078c16c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 0x7f078c16c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42984/0 (socket says 172.21.15.62:42984) 2022-09-17T10:28:03.123 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 -- 172.21.15.62:0/3407228617 learned_addr learned my addr 172.21.15.62:0/3407228617 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:03.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0790a0c700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f078c1752a0 0x7f078c16c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f079120d700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c179090 0x7f078c191280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 -- 172.21.15.62:0/3407228617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c179090 msgr2=0x7f078c191280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c179090 0x7f078c191280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 -- 172.21.15.62:0/3407228617 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f078c1752a0 msgr2=0x7f078c16c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f078c1752a0 0x7f078c16c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 -- 172.21.15.62:0/3407228617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0092a0 con 0x7f078c175680 2022-09-17T10:28:03.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f079120d700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f078c179090 0x7f078c191280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:03.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f078bfff700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 0x7f078c16c9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f078c084670 tx=0x7f077c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c006950 con 0x7f078c175680 2022-09-17T10:28:03.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c011c20 con 0x7f078c175680 2022-09-17T10:28:03.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c01b440 con 0x7f078c175680 2022-09-17T10:28:03.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.112+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c1904c0 con 0x7f078c175680 2022-09-17T10:28:03.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.113+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c190a80 con 0x7f078c175680 2022-09-17T10:28:03.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.113+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f078c06bf40 con 0x7f078c175680 2022-09-17T10:28:03.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.114+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f077c00f070 con 0x7f078c175680 2022-09-17T10:28:03.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f0788ff9700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f077008ba70 0x7f077008df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f077c0b2b60 con 0x7f078c175680 2022-09-17T10:28:03.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f0790a0c700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f077008ba70 0x7f077008df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f0788ff9700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.62:6811/81783,v1:172.21.15.62:6813/81783] conn(0x7f0770097450 0x7f07700998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 --> [v2:172.21.15.62:6811/81783,v1:172.21.15.62:6813/81783] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0770099f70 con 0x7f0770097450 2022-09-17T10:28:03.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f077c0b2ed0 con 0x7f078c175680 2022-09-17T10:28:03.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f079120d700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.62:6811/81783,v1:172.21.15.62:6813/81783] conn(0x7f0770097450 0x7f07700998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f0790a0c700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f077008ba70 0x7f077008df30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0784001d20 tx=0x7f0784009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.115+0000 7f079120d700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.62:6811/81783,v1:172.21.15.62:6813/81783] conn(0x7f0770097450 0x7f07700998f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.116+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 <== osd.3 v2:172.21.15.62:6811/81783 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0770099f70 con 0x7f0770097450 2022-09-17T10:28:03.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 --> [v2:172.21.15.62:6811/81783,v1:172.21.15.62:6813/81783] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f078c17ac30 con 0x7f0770097450 2022-09-17T10:28:03.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0788ff9700 1 -- 172.21.15.62:0/3407228617 <== osd.3 v2:172.21.15.62:6811/81783 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f078c17ac30 con 0x7f0770097450 2022-09-17T10:28:03.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 >> [v2:172.21.15.62:6811/81783,v1:172.21.15.62:6813/81783] conn(0x7f0770097450 msgr2=0x7f07700998f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.62:6811/81783,v1:172.21.15.62:6813/81783] conn(0x7f0770097450 0x7f07700998f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f077008ba70 msgr2=0x7f077008df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f077008ba70 0x7f077008df30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0784001d20 tx=0x7f0784009040).stop 2022-09-17T10:28:03.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 msgr2=0x7f078c16c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 --2- 172.21.15.62:0/3407228617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078c175680 0x7f078c16c9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f078c084670 tx=0x7f077c017000).stop 2022-09-17T10:28:03.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f079120d700 1 -- 172.21.15.62:0/3407228617 reap_dead start 2022-09-17T10:28:03.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 shutdown_connections 2022-09-17T10:28:03.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 >> 172.21.15.62:0/3407228617 conn(0x7f078c0edc30 msgr2=0x7f078c0ea0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 shutdown_connections 2022-09-17T10:28:03.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.131+0000 7f0792c70700 1 -- 172.21.15.62:0/3407228617 wait complete. 2022-09-17T10:28:03.145 INFO:teuthology.orchestra.run.smithi062.stdout:73014444040 2022-09-17T10:28:03.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2022-09-17T10:28:03.265 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.263+0000 7f00a92f5700 1 Processor -- start 2022-09-17T10:28:03.266 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.263+0000 7f00a92f5700 1 -- start start 2022-09-17T10:28:03.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.264+0000 7f00a92f5700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f00a417dcd0 0x7f00a417e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.264+0000 7f00a92f5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a40e50a0 con 0x7f00a417ebf0 2022-09-17T10:28:03.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.264+0000 7f00a92f5700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a40eb330 con 0x7f00a417f070 2022-09-17T10:28:03.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.264+0000 7f00a92f5700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a40eb860 con 0x7f00a417dcd0 2022-09-17T10:28:03.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.264+0000 7f00a37fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f00a417ebf0 0x7f00a40e5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53166/0 (socket says 172.21.15.62:53166) 2022-09-17T10:28:03.273 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.264+0000 7f00a37fe700 1 -- 172.21.15.62:0/3550457862 learned_addr learned my addr 172.21.15.62:0/3550457862 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:03.274 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a3fff700 1 --2- 172.21.15.62:0/3550457862 >> v2:172.21.15.93:3300/0 conn(0x7f00a417dcd0 0x7f00a417e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.274 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208144194 0 0) 0x7f00a40e50a0 con 0x7f00a417ebf0 2022-09-17T10:28:03.274 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00900033f0 con 0x7f00a417ebf0 2022-09-17T10:28:03.274 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1194105847 0 0) 0x7f00900033f0 con 0x7f00a417ebf0 2022-09-17T10:28:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 >> v2:172.21.15.93:3300/0 conn(0x7f00a417dcd0 msgr2=0x7f00a417e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 --2- 172.21.15.62:0/3550457862 >> v2:172.21.15.93:3300/0 conn(0x7f00a417dcd0 0x7f00a417e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 >> v1:172.21.15.93:6789/0 conn(0x7f00a417f070 legacy=0x7f00a40ebc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a417f4e0 con 0x7f00a417ebf0 2022-09-17T10:28:03.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f0094001470 con 0x7f00a417ebf0 2022-09-17T10:28:03.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 >> v1:172.21.15.62:6789/0 conn(0x7f00a417ebf0 legacy=0x7f00a40e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f0090003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0090004690 0x7f0090004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.276 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0090005120 0x7f009000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40eb860 con 0x7f0090003930 2022-09-17T10:28:03.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009000c030 con 0x7f0090005120 2022-09-17T10:28:03.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009000c1f0 con 0x7f0090004690 2022-09-17T10:28:03.277 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a3fff700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f0090003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a8af4700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0090005120 0x7f009000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a37fe700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0090004690 0x7f0090004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a3fff700 1 -- 172.21.15.62:0/3550457862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0090004690 msgr2=0x7f0090004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a3fff700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0090004690 0x7f0090004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.278 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a3fff700 1 -- 172.21.15.62:0/3550457862 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0090005120 msgr2=0x7f009000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.279 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a3fff700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0090005120 0x7f009000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.279 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a8af4700 1 -- 172.21.15.62:0/3550457862 reap_dead start 2022-09-17T10:28:03.279 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.265+0000 7f00a3fff700 1 -- 172.21.15.62:0/3550457862 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00900033f0 con 0x7f0090003930 2022-09-17T10:28:03.279 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a3fff700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f0090003d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0098009a60 tx=0x7f0098009060).ready entity=mon.0 client_cookie=c467f69f7944428f server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.280 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098009ea0 con 0x7f0090003930 2022-09-17T10:28:03.280 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098009430 con 0x7f0090003930 2022-09-17T10:28:03.280 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a2ffd700 1 -- 172.21.15.62:0/3550457862 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800e870 con 0x7f0090003930 2022-09-17T10:28:03.280 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a92f5700 1 -- 172.21.15.62:0/3550457862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 msgr2=0x7f0090003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.280 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a92f5700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f0090003d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0098009a60 tx=0x7f0098009060).stop 2022-09-17T10:28:03.281 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a92f5700 1 -- 172.21.15.62:0/3550457862 shutdown_connections 2022-09-17T10:28:03.281 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a92f5700 1 --2- 172.21.15.62:0/3550457862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f0090003d50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.281 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a92f5700 1 -- 172.21.15.62:0/3550457862 >> 172.21.15.62:0/3550457862 conn(0x7f00a40de5f0 msgr2=0x7f00a405d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.281 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a92f5700 1 -- 172.21.15.62:0/3550457862 shutdown_connections 2022-09-17T10:28:03.282 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.266+0000 7f00a92f5700 1 -- 172.21.15.62:0/3550457862 wait complete. 2022-09-17T10:28:03.282 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.268+0000 7f00a92f5700 1 Processor -- start 2022-09-17T10:28:03.282 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.268+0000 7f00a92f5700 1 -- start start 2022-09-17T10:28:03.282 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a92f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f00a4153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.282 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a92f5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00a4154420 0x7f00a40e08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.283 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a92f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a40e0dd0 0x7f00a4173340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.283 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a92f5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a4172650 con 0x7f0090003930 2022-09-17T10:28:03.283 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a92f5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40e1250 con 0x7f00a4154420 2022-09-17T10:28:03.283 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a92f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a4172eb0 con 0x7f00a40e0dd0 2022-09-17T10:28:03.284 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f00a4153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.284 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f00a4153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42988/0 (socket says 172.21.15.62:42988) 2022-09-17T10:28:03.284 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 -- 172.21.15.62:0/382089551 learned_addr learned my addr 172.21.15.62:0/382089551 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:03.284 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a8af4700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a40e0dd0 0x7f00a4173340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.284 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a37fe700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00a4154420 0x7f00a40e08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.285 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 -- 172.21.15.62:0/382089551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a40e0dd0 msgr2=0x7f00a4173340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.285 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a40e0dd0 0x7f00a4173340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.285 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 -- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00a4154420 msgr2=0x7f00a40e08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.285 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00a4154420 0x7f00a40e08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.286 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 -- 172.21.15.62:0/382089551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a40e1460 con 0x7f0090003930 2022-09-17T10:28:03.286 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a8af4700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00a40e0dd0 0x7f00a4173340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:03.286 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a37fe700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00a4154420 0x7f00a40e08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:03.286 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f00a3fff700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f00a4153f30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f009000c000 tx=0x7f009801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.286 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.269+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009801ba60 con 0x7f0090003930 2022-09-17T10:28:03.287 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.270+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009801bbe0 con 0x7f0090003930 2022-09-17T10:28:03.287 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.270+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098025440 con 0x7f0090003930 2022-09-17T10:28:03.287 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.270+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a40e1740 con 0x7f0090003930 2022-09-17T10:28:03.287 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.270+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a4172b40 con 0x7f0090003930 2022-09-17T10:28:03.288 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.270+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00a406bf00 con 0x7f0090003930 2022-09-17T10:28:03.289 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.271+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f009802b020 con 0x7f0090003930 2022-09-17T10:28:03.290 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.272+0000 7f008bfff700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f008408ba40 0x7f008408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.290 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.272+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f00980b2360 con 0x7f0090003930 2022-09-17T10:28:03.290 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.272+0000 7f008bfff700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6800/81642,v1:172.21.15.93:6801/81642] conn(0x7f0084097420 0x7f00840998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.290 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.272+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 --> [v2:172.21.15.93:6800/81642,v1:172.21.15.93:6801/81642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0084099f40 con 0x7f0084097420 2022-09-17T10:28:03.291 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.272+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00980b26d0 con 0x7f0090003930 2022-09-17T10:28:03.291 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.272+0000 7f00a37fe700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f008408ba40 0x7f008408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.291 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.272+0000 7f00a8af4700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6800/81642,v1:172.21.15.93:6801/81642] conn(0x7f0084097420 0x7f00840998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.291 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.273+0000 7f00a37fe700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f008408ba40 0x7f008408df00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f00940010e0 tx=0x7f0094000fa0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.291 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.273+0000 7f00a8af4700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6800/81642,v1:172.21.15.93:6801/81642] conn(0x7f0084097420 0x7f00840998c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.292 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.273+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 <== osd.4 v2:172.21.15.93:6800/81642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0084099f40 con 0x7f0084097420 2022-09-17T10:28:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.288+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 --> [v2:172.21.15.93:6800/81642,v1:172.21.15.93:6801/81642] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00a4172ff0 con 0x7f0084097420 2022-09-17T10:28:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f008bfff700 1 -- 172.21.15.62:0/382089551 <== osd.4 v2:172.21.15.93:6800/81642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f009c002a80 con 0x7f0084097420 2022-09-17T10:28:03.294 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6800/81642,v1:172.21.15.93:6801/81642] conn(0x7f0084097420 msgr2=0x7f00840998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.295 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6800/81642,v1:172.21.15.93:6801/81642] conn(0x7f0084097420 0x7f00840998c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.295 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f008408ba40 msgr2=0x7f008408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.295 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f008408ba40 0x7f008408df00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f00940010e0 tx=0x7f0094000fa0).stop 2022-09-17T10:28:03.295 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 msgr2=0x7f00a4153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 --2- 172.21.15.62:0/382089551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0090003930 0x7f00a4153f30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f009000c000 tx=0x7f009801a000).stop 2022-09-17T10:28:03.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a8af4700 1 -- 172.21.15.62:0/382089551 reap_dead start 2022-09-17T10:28:03.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 shutdown_connections 2022-09-17T10:28:03.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 >> 172.21.15.62:0/382089551 conn(0x7f00a40de5f0 msgr2=0x7f00a4180e60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 shutdown_connections 2022-09-17T10:28:03.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.289+0000 7f00a92f5700 1 -- 172.21.15.62:0/382089551 wait complete. 2022-09-17T10:28:03.302 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:03.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2022-09-17T10:28:03.421 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.419+0000 7f63853d6700 1 Processor -- start 2022-09-17T10:28:03.422 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.419+0000 7f63853d6700 1 -- start start 2022-09-17T10:28:03.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.420+0000 7f63853d6700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f63801751b0 0x7f6380180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.420+0000 7f63853d6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63800c6dd0 con 0x7f6380175590 2022-09-17T10:28:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.420+0000 7f63853d6700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63801801e0 con 0x7f63800ef650 2022-09-17T10:28:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.420+0000 7f63853d6700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63800f10e0 con 0x7f63801751b0 2022-09-17T10:28:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637e7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6380175590 0x7f6380180b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53182/0 (socket says 172.21.15.62:53182) 2022-09-17T10:28:03.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637e7fc700 1 -- 172.21.15.62:0/1558201424 learned_addr learned my addr 172.21.15.62:0/1558201424 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:03.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637effd700 1 --2- 172.21.15.62:0/1558201424 >> v2:172.21.15.159:3300/0 conn(0x7f63801751b0 0x7f6380180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.436 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123836337 0 0) 0x7f63800c6dd0 con 0x7f6380175590 2022-09-17T10:28:03.436 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63600033f0 con 0x7f6380175590 2022-09-17T10:28:03.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3287732074 0 0) 0x7f63600033f0 con 0x7f6380175590 2022-09-17T10:28:03.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 >> v2:172.21.15.159:3300/0 conn(0x7f63801751b0 msgr2=0x7f6380180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 --2- 172.21.15.62:0/1558201424 >> v2:172.21.15.159:3300/0 conn(0x7f63801751b0 0x7f6380180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 >> v1:172.21.15.93:6789/0 conn(0x7f63800ef650 legacy=0x7f63800efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63800f0840 con 0x7f6380175590 2022-09-17T10:28:03.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f6368001470 con 0x7f6380175590 2022-09-17T10:28:03.440 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637effd700 1 --2- 172.21.15.62:0/1558201424 >> v2:172.21.15.159:3300/0 conn(0x7f63801751b0 0x7f6380180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:28:03.440 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 >> v1:172.21.15.62:6789/0 conn(0x7f6380175590 legacy=0x7f6380180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.440 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f6360003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.441 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6360004690 0x7f6360004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6360005000 0x7f636000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63800f10e0 con 0x7f63600038e0 2022-09-17T10:28:03.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636000bf90 con 0x7f6360005000 2022-09-17T10:28:03.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636000c150 con 0x7f6360004690 2022-09-17T10:28:03.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637effd700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f6360003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637e7fc700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6360004690 0x7f6360004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.421+0000 7f637f7fe700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6360005000 0x7f636000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637effd700 1 -- 172.21.15.62:0/1558201424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6360004690 msgr2=0x7f6360004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637effd700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6360004690 0x7f6360004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637effd700 1 -- 172.21.15.62:0/1558201424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6360005000 msgr2=0x7f636000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637effd700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6360005000 0x7f636000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637effd700 1 -- 172.21.15.62:0/1558201424 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63600033f0 con 0x7f63600038e0 2022-09-17T10:28:03.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637f7fe700 1 -- 172.21.15.62:0/1558201424 reap_dead start 2022-09-17T10:28:03.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637effd700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f6360003cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f637800e3c0 tx=0x7f637800b040).ready entity=mon.0 client_cookie=81b0f8eb0c8b4a8 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378009c50 con 0x7f63600038e0 2022-09-17T10:28:03.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637800f040 con 0x7f63600038e0 2022-09-17T10:28:03.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f637dffb700 1 -- 172.21.15.62:0/1558201424 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800ee80 con 0x7f63600038e0 2022-09-17T10:28:03.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f63853d6700 1 -- 172.21.15.62:0/1558201424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 msgr2=0x7f6360003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f63853d6700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f6360003cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f637800e3c0 tx=0x7f637800b040).stop 2022-09-17T10:28:03.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f63853d6700 1 -- 172.21.15.62:0/1558201424 shutdown_connections 2022-09-17T10:28:03.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f63853d6700 1 --2- 172.21.15.62:0/1558201424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f6360003cc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.422+0000 7f63853d6700 1 -- 172.21.15.62:0/1558201424 >> 172.21.15.62:0/1558201424 conn(0x7f638006a170 msgr2=0x7f63800f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.423+0000 7f63853d6700 1 -- 172.21.15.62:0/1558201424 shutdown_connections 2022-09-17T10:28:03.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.423+0000 7f63853d6700 1 -- 172.21.15.62:0/1558201424 wait complete. 2022-09-17T10:28:03.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.424+0000 7f63853d6700 1 Processor -- start 2022-09-17T10:28:03.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.424+0000 7f63853d6700 1 -- start start 2022-09-17T10:28:03.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f63853d6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f638017d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f63853d6700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f638018f8a0 0x7f6380164cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f63853d6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f638018fd20 0x7f63801651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f63853d6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63800642b0 con 0x7f63600038e0 2022-09-17T10:28:03.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f63853d6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638017ceb0 con 0x7f638018fd20 2022-09-17T10:28:03.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f63853d6700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6380063fd0 con 0x7f638018f8a0 2022-09-17T10:28:03.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f638017d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f638017d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43000/0 (socket says 172.21.15.62:43000) 2022-09-17T10:28:03.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637effd700 1 -- 172.21.15.62:0/3205436415 learned_addr learned my addr 172.21.15.62:0/3205436415 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:03.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637e7fc700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f638018f8a0 0x7f6380164cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637effd700 1 -- 172.21.15.62:0/3205436415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f638018f8a0 msgr2=0x7f6380164cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637effd700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f638018f8a0 0x7f6380164cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.452 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637f7fe700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f638018fd20 0x7f63801651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.452 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637effd700 1 -- 172.21.15.62:0/3205436415 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f638018fd20 msgr2=0x7f63801651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.452 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.425+0000 7f637effd700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f638018fd20 0x7f63801651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.452 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.426+0000 7f637effd700 1 -- 172.21.15.62:0/3205436415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638017c580 con 0x7f63600038e0 2022-09-17T10:28:03.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.426+0000 7f637effd700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f638017d340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f637800e9b0 tx=0x7f637801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.426+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637801c450 con 0x7f63600038e0 2022-09-17T10:28:03.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.426+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378023070 con 0x7f63600038e0 2022-09-17T10:28:03.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.426+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637801c5f0 con 0x7f63600038e0 2022-09-17T10:28:03.454 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.426+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638017c860 con 0x7f63600038e0 2022-09-17T10:28:03.454 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.426+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6380063320 con 0x7f63600038e0 2022-09-17T10:28:03.454 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.427+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f638017cd00 con 0x7f63600038e0 2022-09-17T10:28:03.454 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.428+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f637802f070 con 0x7f63600038e0 2022-09-17T10:28:03.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.428+0000 7f6376ffd700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f636408ba40 0x7f636408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.428+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f63780b31c0 con 0x7f63600038e0 2022-09-17T10:28:03.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.428+0000 7f6376ffd700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.159:6800/81896,v1:172.21.15.159:6802/81896] conn(0x7f6364097420 0x7f63640998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.428+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 --> [v2:172.21.15.159:6800/81896,v1:172.21.15.159:6802/81896] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6364099f40 con 0x7f6364097420 2022-09-17T10:28:03.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.428+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f637800e020 con 0x7f63600038e0 2022-09-17T10:28:03.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.428+0000 7f637e7fc700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f636408ba40 0x7f636408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.429+0000 7f637f7fe700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.159:6800/81896,v1:172.21.15.159:6802/81896] conn(0x7f6364097420 0x7f63640998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.429+0000 7f637e7fc700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f636408ba40 0x7f636408df00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6368001440 tx=0x7f6368009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.429+0000 7f637f7fe700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.159:6800/81896,v1:172.21.15.159:6802/81896] conn(0x7f6364097420 0x7f63640998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.457 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.430+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 <== osd.5 v2:172.21.15.159:6800/81896 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f6364099f40 con 0x7f6364097420 2022-09-17T10:28:03.457 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.444+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 --> [v2:172.21.15.159:6800/81896,v1:172.21.15.159:6802/81896] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f638017d190 con 0x7f6364097420 2022-09-17T10:28:03.458 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.444+0000 7f6376ffd700 1 -- 172.21.15.62:0/3205436415 <== osd.5 v2:172.21.15.159:6800/81896 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f638017d190 con 0x7f6364097420 2022-09-17T10:28:03.460 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 >> [v2:172.21.15.159:6800/81896,v1:172.21.15.159:6802/81896] conn(0x7f6364097420 msgr2=0x7f63640998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.159:6800/81896,v1:172.21.15.159:6802/81896] conn(0x7f6364097420 0x7f63640998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f636408ba40 msgr2=0x7f636408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f636408ba40 0x7f636408df00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6368001440 tx=0x7f6368009040).stop 2022-09-17T10:28:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 msgr2=0x7f638017d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 --2- 172.21.15.62:0/3205436415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63600038e0 0x7f638017d340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f637800e9b0 tx=0x7f637801a000).stop 2022-09-17T10:28:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f637f7fe700 1 -- 172.21.15.62:0/3205436415 reap_dead start 2022-09-17T10:28:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 shutdown_connections 2022-09-17T10:28:03.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 >> 172.21.15.62:0/3205436415 conn(0x7f638006a170 msgr2=0x7f63800f0120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 shutdown_connections 2022-09-17T10:28:03.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.445+0000 7f63853d6700 1 -- 172.21.15.62:0/3205436415 wait complete. 2022-09-17T10:28:03.463 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:03.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2022-09-17T10:28:03.581 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.579+0000 7f6df3bdf700 1 Processor -- start 2022-09-17T10:28:03.583 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.579+0000 7f6df3bdf700 1 -- start start 2022-09-17T10:28:03.593 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df3bdf700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6dec17e3c0 0x7f6dec0683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.594 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df3bdf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6dec069db0 0x7f6dec17f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.594 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df3bdf700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec17f750 con 0x7f6dec17dfe0 2022-09-17T10:28:03.595 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df3bdf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec06a240 con 0x7f6dec069db0 2022-09-17T10:28:03.595 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df3bdf700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec068a30 con 0x7f6dec17e3c0 2022-09-17T10:28:03.595 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df217c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6dec069db0 0x7f6dec17f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.596 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df217c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6dec069db0 0x7f6dec17f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43002/0 (socket says 172.21.15.62:43002) 2022-09-17T10:28:03.596 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df217c700 1 -- 172.21.15.62:0/4195626198 learned_addr learned my addr 172.21.15.62:0/4195626198 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:03.596 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df117a700 1 --2- 172.21.15.62:0/4195626198 >> v2:172.21.15.93:3300/0 conn(0x7f6dec17e3c0 0x7f6dec0683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.597 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df217c700 1 -- 172.21.15.62:0/4195626198 >> v2:172.21.15.93:3300/0 conn(0x7f6dec17e3c0 msgr2=0x7f6dec0683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.597 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df217c700 1 --2- 172.21.15.62:0/4195626198 >> v2:172.21.15.93:3300/0 conn(0x7f6dec17e3c0 0x7f6dec0683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.597 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df217c700 1 -- 172.21.15.62:0/4195626198 >> v1:172.21.15.159:6789/0 conn(0x7f6dec17dfe0 legacy=0x7f6dec084010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.598 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df217c700 1 -- 172.21.15.62:0/4195626198 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec068d10 con 0x7f6dec069db0 2022-09-17T10:28:03.598 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df217c700 1 --2- 172.21.15.62:0/4195626198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec069db0 0x7f6dec17f260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f6ddc009f20 tx=0x7f6ddc009840).ready entity=mon.0 client_cookie=95f4516dde4d3928 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.598 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df0979700 1 -- 172.21.15.62:0/4195626198 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00e070 con 0x7f6dec069db0 2022-09-17T10:28:03.599 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df0979700 1 -- 172.21.15.62:0/4195626198 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc00ba40 con 0x7f6dec069db0 2022-09-17T10:28:03.599 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.581+0000 7f6df0979700 1 -- 172.21.15.62:0/4195626198 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00bdc0 con 0x7f6dec069db0 2022-09-17T10:28:03.599 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.582+0000 7f6df3bdf700 1 -- 172.21.15.62:0/4195626198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec069db0 msgr2=0x7f6dec17f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.599 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.582+0000 7f6df3bdf700 1 --2- 172.21.15.62:0/4195626198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec069db0 0x7f6dec17f260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f6ddc009f20 tx=0x7f6ddc009840).stop 2022-09-17T10:28:03.600 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.582+0000 7f6df3bdf700 1 -- 172.21.15.62:0/4195626198 shutdown_connections 2022-09-17T10:28:03.600 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.582+0000 7f6df3bdf700 1 --2- 172.21.15.62:0/4195626198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec069db0 0x7f6dec17f260 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.600 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.582+0000 7f6df3bdf700 1 --2- 172.21.15.62:0/4195626198 >> v2:172.21.15.93:3300/0 conn(0x7f6dec17e3c0 0x7f6dec0683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.600 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.582+0000 7f6df3bdf700 1 -- 172.21.15.62:0/4195626198 >> 172.21.15.62:0/4195626198 conn(0x7f6dec062a40 msgr2=0x7f6dec0f2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.600 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.582+0000 7f6df3bdf700 1 -- 172.21.15.62:0/4195626198 shutdown_connections 2022-09-17T10:28:03.601 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.582+0000 7f6df3bdf700 1 -- 172.21.15.62:0/4195626198 wait complete. 2022-09-17T10:28:03.601 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.583+0000 7f6df3bdf700 1 Processor -- start 2022-09-17T10:28:03.601 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.583+0000 7f6df3bdf700 1 -- start start 2022-09-17T10:28:03.601 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df3bdf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dec069db0 0x7f6dec0e7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.602 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df3bdf700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dec17dfe0 0x7f6dec0eb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.602 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df3bdf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec17e3c0 0x7f6dec16b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.602 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df3bdf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0e7600 con 0x7f6dec17e3c0 2022-09-17T10:28:03.602 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df3bdf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0e6750 con 0x7f6dec069db0 2022-09-17T10:28:03.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df3bdf700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0e69f0 con 0x7f6dec17dfe0 2022-09-17T10:28:03.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df217c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec17e3c0 0x7f6dec16b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df217c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec17e3c0 0x7f6dec16b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43012/0 (socket says 172.21.15.62:43012) 2022-09-17T10:28:03.603 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.584+0000 7f6df217c700 1 -- 172.21.15.62:0/3717453858 learned_addr learned my addr 172.21.15.62:0/3717453858 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:03.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df117a700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dec17dfe0 0x7f6dec0eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df197b700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dec069db0 0x7f6dec0e7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df217c700 1 -- 172.21.15.62:0/3717453858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dec17dfe0 msgr2=0x7f6dec0eb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df217c700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dec17dfe0 0x7f6dec0eb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.604 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df217c700 1 -- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dec069db0 msgr2=0x7f6dec0e7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df217c700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dec069db0 0x7f6dec0e7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df217c700 1 -- 172.21.15.62:0/3717453858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc009ae0 con 0x7f6dec17e3c0 2022-09-17T10:28:03.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df197b700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dec069db0 0x7f6dec0e7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:03.605 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df217c700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec17e3c0 0x7f6dec16b7d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6dec0ed1e0 tx=0x7f6ddc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00bdc0 con 0x7f6dec17e3c0 2022-09-17T10:28:03.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc01d460 con 0x7f6dec17e3c0 2022-09-17T10:28:03.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec0e6cd0 con 0x7f6dec17e3c0 2022-09-17T10:28:03.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc01d7e0 con 0x7f6dec17e3c0 2022-09-17T10:28:03.606 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.585+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec0e7290 con 0x7f6dec17e3c0 2022-09-17T10:28:03.607 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.586+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dec06bf40 con 0x7f6dec17e3c0 2022-09-17T10:28:03.607 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.587+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f6ddc024030 con 0x7f6dec17e3c0 2022-09-17T10:28:03.607 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.587+0000 7f6de9ffb700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6dcc08ba40 0x7f6dcc08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.607 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.588+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6ddc0b1f80 con 0x7f6dec17e3c0 2022-09-17T10:28:03.608 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.588+0000 7f6df197b700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6dcc08ba40 0x7f6dcc08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.608 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.588+0000 7f6de9ffb700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.62:6824/81817,v1:172.21.15.62:6825/81817] conn(0x7f6dcc097420 0x7f6dcc0998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.608 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.588+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 --> [v2:172.21.15.62:6824/81817,v1:172.21.15.62:6825/81817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6dcc099f40 con 0x7f6dcc097420 2022-09-17T10:28:03.608 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.588+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ddc0b7510 con 0x7f6dec17e3c0 2022-09-17T10:28:03.609 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.588+0000 7f6df117a700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.62:6824/81817,v1:172.21.15.62:6825/81817] conn(0x7f6dcc097420 0x7f6dcc0998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.609 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.588+0000 7f6df197b700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6dcc08ba40 0x7f6dcc08df00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6de4000c00 tx=0x7f6de4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.609 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.588+0000 7f6df117a700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.62:6824/81817,v1:172.21.15.62:6825/81817] conn(0x7f6dcc097420 0x7f6dcc0998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.609 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.589+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 <== osd.6 v2:172.21.15.62:6824/81817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f6dcc099f40 con 0x7f6dcc097420 2022-09-17T10:28:03.611 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.603+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 --> [v2:172.21.15.62:6824/81817,v1:172.21.15.62:6825/81817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6dec068ff0 con 0x7f6dcc097420 2022-09-17T10:28:03.611 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.603+0000 7f6de9ffb700 1 -- 172.21.15.62:0/3717453858 <== osd.6 v2:172.21.15.62:6824/81817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6dec068ff0 con 0x7f6dcc097420 2022-09-17T10:28:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 >> [v2:172.21.15.62:6824/81817,v1:172.21.15.62:6825/81817] conn(0x7f6dcc097420 msgr2=0x7f6dcc0998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.62:6824/81817,v1:172.21.15.62:6825/81817] conn(0x7f6dcc097420 0x7f6dcc0998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6dcc08ba40 msgr2=0x7f6dcc08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6dcc08ba40 0x7f6dcc08df00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6de4000c00 tx=0x7f6de4009040).stop 2022-09-17T10:28:03.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec17e3c0 msgr2=0x7f6dec16b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 --2- 172.21.15.62:0/3717453858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dec17e3c0 0x7f6dec16b7d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6dec0ed1e0 tx=0x7f6ddc009840).stop 2022-09-17T10:28:03.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df217c700 1 -- 172.21.15.62:0/3717453858 reap_dead start 2022-09-17T10:28:03.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 shutdown_connections 2022-09-17T10:28:03.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 >> 172.21.15.62:0/3717453858 conn(0x7f6dec062a40 msgr2=0x7f6dec084010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 shutdown_connections 2022-09-17T10:28:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.604+0000 7f6df3bdf700 1 -- 172.21.15.62:0/3717453858 wait complete. 2022-09-17T10:28:03.617 INFO:teuthology.orchestra.run.smithi062.stdout:73014444040 2022-09-17T10:28:03.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2022-09-17T10:28:03.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.734+0000 7fe609981700 1 Processor -- start 2022-09-17T10:28:03.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.734+0000 7fe609981700 1 -- start start 2022-09-17T10:28:03.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe609981700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe60417e190 0x7fe6040ec680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe609981700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe604178800 0x7fe60417c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe609981700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60417dd00 con 0x7fe604178420 2022-09-17T10:28:03.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe609981700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6040ecb70 con 0x7fe604178800 2022-09-17T10:28:03.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe609981700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6040e8ce0 con 0x7fe60417e190 2022-09-17T10:28:03.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe6037fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe604178800 0x7fe60417c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe602ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe604178420 0x7fe6040e85d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53196/0 (socket says 172.21.15.62:53196) 2022-09-17T10:28:03.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe6037fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe604178800 0x7fe60417c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43016/0 (socket says 172.21.15.62:43016) 2022-09-17T10:28:03.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe602ffd700 1 -- 172.21.15.62:0/2567492660 learned_addr learned my addr 172.21.15.62:0/2567492660 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:03.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe6027fc700 1 --2- 172.21.15.62:0/2567492660 >> v2:172.21.15.93:3300/0 conn(0x7fe60417e190 0x7fe6040ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe6037fe700 1 -- 172.21.15.62:0/2567492660 >> v2:172.21.15.93:3300/0 conn(0x7fe60417e190 msgr2=0x7fe6040ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe6037fe700 1 --2- 172.21.15.62:0/2567492660 >> v2:172.21.15.93:3300/0 conn(0x7fe60417e190 0x7fe6040ec680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe6037fe700 1 -- 172.21.15.62:0/2567492660 >> v1:172.21.15.62:6789/0 conn(0x7fe604178420 legacy=0x7fe6040e85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe6037fe700 1 -- 172.21.15.62:0/2567492660 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60417e610 con 0x7fe604178800 2022-09-17T10:28:03.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe601ffb700 1 -- 172.21.15.62:0/2567492660 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246206499 0 0) 0x7fe60417dd00 con 0x7fe604178420 2022-09-17T10:28:03.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe6037fe700 1 --2- 172.21.15.62:0/2567492660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe604178800 0x7fe60417c3d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fe6040edb60 tx=0x7fe5f4009060).ready entity=mon.0 client_cookie=5e2d62e372ba6776 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe601ffb700 1 -- 172.21.15.62:0/2567492660 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400f510 con 0x7fe604178800 2022-09-17T10:28:03.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe601ffb700 1 -- 172.21.15.62:0/2567492660 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f400f670 con 0x7fe604178800 2022-09-17T10:28:03.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.735+0000 7fe601ffb700 1 -- 172.21.15.62:0/2567492660 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400f9f0 con 0x7fe604178800 2022-09-17T10:28:03.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.736+0000 7fe609981700 1 -- 172.21.15.62:0/2567492660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe604178800 msgr2=0x7fe60417c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.736+0000 7fe609981700 1 --2- 172.21.15.62:0/2567492660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe604178800 0x7fe60417c3d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fe6040edb60 tx=0x7fe5f4009060).stop 2022-09-17T10:28:03.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.736+0000 7fe609981700 1 -- 172.21.15.62:0/2567492660 shutdown_connections 2022-09-17T10:28:03.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.736+0000 7fe609981700 1 --2- 172.21.15.62:0/2567492660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe604178800 0x7fe60417c3d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.736+0000 7fe609981700 1 --2- 172.21.15.62:0/2567492660 >> v2:172.21.15.93:3300/0 conn(0x7fe60417e190 0x7fe6040ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.736+0000 7fe609981700 1 -- 172.21.15.62:0/2567492660 >> 172.21.15.62:0/2567492660 conn(0x7fe6040edc30 msgr2=0x7fe6040ee040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.736+0000 7fe609981700 1 -- 172.21.15.62:0/2567492660 shutdown_connections 2022-09-17T10:28:03.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.736+0000 7fe609981700 1 -- 172.21.15.62:0/2567492660 wait complete. 2022-09-17T10:28:03.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.737+0000 7fe609981700 1 Processor -- start 2022-09-17T10:28:03.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.737+0000 7fe609981700 1 -- start start 2022-09-17T10:28:03.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.738+0000 7fe609981700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe604178420 0x7fe6041797e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.738+0000 7fe609981700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe604178800 0x7fe60416c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.738+0000 7fe609981700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe60417e190 0x7fe6040e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.738+0000 7fe609981700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60416d170 con 0x7fe60417e190 2022-09-17T10:28:03.752 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.738+0000 7fe609981700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60416d450 con 0x7fe604178420 2022-09-17T10:28:03.752 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.738+0000 7fe609981700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60416d730 con 0x7fe604178800 2022-09-17T10:28:03.752 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe60417e190 0x7fe6040e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.752 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe60417e190 0x7fe6040e8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43026/0 (socket says 172.21.15.62:43026) 2022-09-17T10:28:03.753 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 -- 172.21.15.62:0/1027973355 learned_addr learned my addr 172.21.15.62:0/1027973355 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:03.753 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe602ffd700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe604178420 0x7fe6041797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.753 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6027fc700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe604178800 0x7fe60416c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.753 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 -- 172.21.15.62:0/1027973355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe604178800 msgr2=0x7fe60416c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.754 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe604178800 0x7fe60416c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 -- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe604178420 msgr2=0x7fe6041797e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe604178420 0x7fe6041797e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 -- 172.21.15.62:0/1027973355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40092a0 con 0x7fe60417e190 2022-09-17T10:28:03.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe602ffd700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe604178420 0x7fe6041797e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:03.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6027fc700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe604178800 0x7fe60416c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:03.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe6037fe700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe60417e190 0x7fe6040e8f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fe5f4009dd0 tx=0x7fe5f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400f9f0 con 0x7fe60417e190 2022-09-17T10:28:03.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f401b440 con 0x7fe60417e190 2022-09-17T10:28:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f401b800 con 0x7fe60417e190 2022-09-17T10:28:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60416da10 con 0x7fe60417e190 2022-09-17T10:28:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.739+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60416dfd0 con 0x7fe60417e190 2022-09-17T10:28:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.740+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe60406bf40 con 0x7fe60417e190 2022-09-17T10:28:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.741+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe5f400f070 con 0x7fe60417e190 2022-09-17T10:28:03.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.741+0000 7fe5faffd700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe5e808ba40 0x7fe5e808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.742+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fe5f40b2bc0 con 0x7fe60417e190 2022-09-17T10:28:03.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.742+0000 7fe5faffd700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6808/81643,v1:172.21.15.93:6809/81643] conn(0x7fe5e8097420 0x7fe5e80998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.742+0000 7fe602ffd700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe5e808ba40 0x7fe5e808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.742+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 --> [v2:172.21.15.93:6808/81643,v1:172.21.15.93:6809/81643] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5e8099f40 con 0x7fe5e8097420 2022-09-17T10:28:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.742+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5f40b2eb0 con 0x7fe60417e190 2022-09-17T10:28:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.742+0000 7fe6027fc700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6808/81643,v1:172.21.15.93:6809/81643] conn(0x7fe5e8097420 0x7fe5e80998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.742+0000 7fe602ffd700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe5e808ba40 0x7fe5e808df00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe5fc007fd0 tx=0x7fe5fc009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.760 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.742+0000 7fe6027fc700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6808/81643,v1:172.21.15.93:6809/81643] conn(0x7fe5e8097420 0x7fe5e80998c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.760 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.743+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 <== osd.7 v2:172.21.15.93:6808/81643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe5e8099f40 con 0x7fe5e8097420 2022-09-17T10:28:03.761 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.757+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 --> [v2:172.21.15.93:6808/81643,v1:172.21.15.93:6809/81643] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe604066770 con 0x7fe5e8097420 2022-09-17T10:28:03.761 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.758+0000 7fe5faffd700 1 -- 172.21.15.62:0/1027973355 <== osd.7 v2:172.21.15.93:6808/81643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe604066770 con 0x7fe5e8097420 2022-09-17T10:28:03.763 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.758+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6808/81643,v1:172.21.15.93:6809/81643] conn(0x7fe5e8097420 msgr2=0x7fe5e80998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.763 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.758+0000 7fe609981700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6808/81643,v1:172.21.15.93:6809/81643] conn(0x7fe5e8097420 0x7fe5e80998c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.763 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.758+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe5e808ba40 msgr2=0x7fe5e808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.763 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.758+0000 7fe609981700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe5e808ba40 0x7fe5e808df00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe5fc007fd0 tx=0x7fe5fc009040).stop 2022-09-17T10:28:03.764 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.758+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe60417e190 msgr2=0x7fe6040e8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.764 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.758+0000 7fe609981700 1 --2- 172.21.15.62:0/1027973355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe60417e190 0x7fe6040e8f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fe5f4009dd0 tx=0x7fe5f4017000).stop 2022-09-17T10:28:03.764 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.758+0000 7fe6037fe700 1 -- 172.21.15.62:0/1027973355 reap_dead start 2022-09-17T10:28:03.764 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.759+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 shutdown_connections 2022-09-17T10:28:03.765 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.759+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 >> 172.21.15.62:0/1027973355 conn(0x7fe6040edc30 msgr2=0x7fe6040ee010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.765 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.759+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 shutdown_connections 2022-09-17T10:28:03.766 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.759+0000 7fe609981700 1 -- 172.21.15.62:0/1027973355 wait complete. 2022-09-17T10:28:03.772 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:03.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2022-09-17T10:28:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.888+0000 7fa4913a7700 1 Processor -- start 2022-09-17T10:28:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.888+0000 7fa4913a7700 1 -- start start 2022-09-17T10:28:03.900 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.889+0000 7fa4913a7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa48c1751b0 0x7fa48c180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.901 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.889+0000 7fa4913a7700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa48c0ef650 0x7fa48c0efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.901 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.889+0000 7fa4913a7700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c0c6dd0 con 0x7fa48c175590 2022-09-17T10:28:03.901 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.889+0000 7fa4913a7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c0f10e0 con 0x7fa48c1751b0 2022-09-17T10:28:03.901 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.889+0000 7fa4913a7700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c1801e0 con 0x7fa48c0ef650 2022-09-17T10:28:03.902 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.889+0000 7fa48affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa48c1751b0 0x7fa48c180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.902 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.889+0000 7fa48affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa48c1751b0 0x7fa48c180670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43028/0 (socket says 172.21.15.62:43028) 2022-09-17T10:28:03.902 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.889+0000 7fa48affd700 1 -- 172.21.15.62:0/4159752191 learned_addr learned my addr 172.21.15.62:0/4159752191 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:03.903 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa48b7fe700 1 --2- 172.21.15.62:0/4159752191 >> v2:172.21.15.159:3300/0 conn(0x7fa48c0ef650 0x7fa48c0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.903 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa48affd700 1 -- 172.21.15.62:0/4159752191 >> v2:172.21.15.159:3300/0 conn(0x7fa48c0ef650 msgr2=0x7fa48c0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:03.903 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa48affd700 1 --2- 172.21.15.62:0/4159752191 >> v2:172.21.15.159:3300/0 conn(0x7fa48c0ef650 0x7fa48c0efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.903 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa48affd700 1 -- 172.21.15.62:0/4159752191 >> v1:172.21.15.93:6789/0 conn(0x7fa48c175590 legacy=0x7fa48c180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.904 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa48affd700 1 -- 172.21.15.62:0/4159752191 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0f0840 con 0x7fa48c1751b0 2022-09-17T10:28:03.904 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa48affd700 1 --2- 172.21.15.62:0/4159752191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c1751b0 0x7fa48c180670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa48c088650 tx=0x7fa484009840).ready entity=mon.0 client_cookie=744bc77764fb8e94 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.904 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa489ffb700 1 -- 172.21.15.62:0/4159752191 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400e070 con 0x7fa48c1751b0 2022-09-17T10:28:03.905 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa489ffb700 1 -- 172.21.15.62:0/4159752191 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48400ba50 con 0x7fa48c1751b0 2022-09-17T10:28:03.905 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa489ffb700 1 -- 172.21.15.62:0/4159752191 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400bdd0 con 0x7fa48c1751b0 2022-09-17T10:28:03.905 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa4913a7700 1 -- 172.21.15.62:0/4159752191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c1751b0 msgr2=0x7fa48c180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.905 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa4913a7700 1 --2- 172.21.15.62:0/4159752191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c1751b0 0x7fa48c180670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa48c088650 tx=0x7fa484009840).stop 2022-09-17T10:28:03.906 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa4913a7700 1 -- 172.21.15.62:0/4159752191 shutdown_connections 2022-09-17T10:28:03.906 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa4913a7700 1 --2- 172.21.15.62:0/4159752191 >> v2:172.21.15.159:3300/0 conn(0x7fa48c0ef650 0x7fa48c0efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.906 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa4913a7700 1 --2- 172.21.15.62:0/4159752191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c1751b0 0x7fa48c180670 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.906 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa4913a7700 1 -- 172.21.15.62:0/4159752191 >> 172.21.15.62:0/4159752191 conn(0x7fa48c06a170 msgr2=0x7fa48c0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.907 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa4913a7700 1 -- 172.21.15.62:0/4159752191 shutdown_connections 2022-09-17T10:28:03.907 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.890+0000 7fa4913a7700 1 -- 172.21.15.62:0/4159752191 wait complete. 2022-09-17T10:28:03.907 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.892+0000 7fa4913a7700 1 Processor -- start 2022-09-17T10:28:03.907 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.892+0000 7fa4913a7700 1 -- start start 2022-09-17T10:28:03.908 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa4913a7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c0ef650 0x7fa48c16ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.908 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa4913a7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa48c1751b0 0x7fa48c085820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.908 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa4913a7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa48c175590 0x7fa48c17c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.908 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa4913a7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c17dec0 con 0x7fa48c0ef650 2022-09-17T10:28:03.908 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa4913a7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c17cfd0 con 0x7fa48c1751b0 2022-09-17T10:28:03.909 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa4913a7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c17d2b0 con 0x7fa48c175590 2022-09-17T10:28:03.909 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c0ef650 0x7fa48c16ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.909 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c0ef650 0x7fa48c16ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43036/0 (socket says 172.21.15.62:43036) 2022-09-17T10:28:03.909 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48affd700 1 -- 172.21.15.62:0/1094420175 learned_addr learned my addr 172.21.15.62:0/1094420175 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:03.910 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48b7fe700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa48c175590 0x7fa48c17c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.910 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48a7fc700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa48c1751b0 0x7fa48c085820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.910 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48affd700 1 -- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa48c175590 msgr2=0x7fa48c17c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.910 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48affd700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa48c175590 0x7fa48c17c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.911 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48affd700 1 -- 172.21.15.62:0/1094420175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa48c1751b0 msgr2=0x7fa48c085820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.911 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48affd700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa48c1751b0 0x7fa48c085820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.911 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48affd700 1 -- 172.21.15.62:0/1094420175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484009ae0 con 0x7fa48c0ef650 2022-09-17T10:28:03.911 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.893+0000 7fa48b7fe700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa48c175590 0x7fa48c17c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:03.912 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.894+0000 7fa48affd700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c0ef650 0x7fa48c16ddd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fa48c088960 tx=0x7fa484009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.912 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.894+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400bbc0 con 0x7fa48c0ef650 2022-09-17T10:28:03.912 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.894+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48400bd20 con 0x7fa48c0ef650 2022-09-17T10:28:03.912 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.894+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c17d590 con 0x7fa48c0ef650 2022-09-17T10:28:03.913 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.894+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48401e6a0 con 0x7fa48c0ef650 2022-09-17T10:28:03.913 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.894+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c17db50 con 0x7fa48c0ef650 2022-09-17T10:28:03.913 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.894+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa48c06bf40 con 0x7fa48c0ef650 2022-09-17T10:28:03.913 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.896+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fa48402f070 con 0x7fa48c0ef650 2022-09-17T10:28:03.914 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.896+0000 7fa482ffd700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa47008ba40 0x7fa47008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.914 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.896+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa4840b2ad0 con 0x7fa48c0ef650 2022-09-17T10:28:03.915 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.896+0000 7fa482ffd700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:6824/81940,v1:172.21.15.159:6825/81940] conn(0x7fa470097420 0x7fa4700998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:03.915 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.896+0000 7fa48a7fc700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa47008ba40 0x7fa47008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.915 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.896+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 --> [v2:172.21.15.159:6824/81940,v1:172.21.15.159:6825/81940] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa470099f40 con 0x7fa470097420 2022-09-17T10:28:03.916 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.896+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4840b2e40 con 0x7fa48c0ef650 2022-09-17T10:28:03.916 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.897+0000 7fa48a7fc700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa47008ba40 0x7fa47008df00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa48c0ef270 tx=0x7fa474009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.916 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.897+0000 7fa48b7fe700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:6824/81940,v1:172.21.15.159:6825/81940] conn(0x7fa470097420 0x7fa4700998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:03.916 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.897+0000 7fa48b7fe700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:6824/81940,v1:172.21.15.159:6825/81940] conn(0x7fa470097420 0x7fa4700998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:03.917 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.898+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 <== osd.8 v2:172.21.15.159:6824/81940 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa470099f40 con 0x7fa470097420 2022-09-17T10:28:03.918 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.912+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 --> [v2:172.21.15.159:6824/81940,v1:172.21.15.159:6825/81940] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa48c17e000 con 0x7fa470097420 2022-09-17T10:28:03.918 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa482ffd700 1 -- 172.21.15.62:0/1094420175 <== osd.8 v2:172.21.15.159:6824/81940 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa47c00bb80 con 0x7fa470097420 2022-09-17T10:28:03.920 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:6824/81940,v1:172.21.15.159:6825/81940] conn(0x7fa470097420 msgr2=0x7fa4700998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.920 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.159:6824/81940,v1:172.21.15.159:6825/81940] conn(0x7fa470097420 0x7fa4700998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:03.920 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa47008ba40 msgr2=0x7fa47008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.920 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa47008ba40 0x7fa47008df00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa48c0ef270 tx=0x7fa474009040).stop 2022-09-17T10:28:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c0ef650 msgr2=0x7fa48c16ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 --2- 172.21.15.62:0/1094420175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48c0ef650 0x7fa48c16ddd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fa48c088960 tx=0x7fa484009840).stop 2022-09-17T10:28:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa48b7fe700 1 -- 172.21.15.62:0/1094420175 reap_dead start 2022-09-17T10:28:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 shutdown_connections 2022-09-17T10:28:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 >> 172.21.15.62:0/1094420175 conn(0x7fa48c06a170 msgr2=0x7fa48c17e870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 shutdown_connections 2022-09-17T10:28:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:03.913+0000 7fa4913a7700 1 -- 172.21.15.62:0/1094420175 wait complete. 2022-09-17T10:28:03.927 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:03.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2022-09-17T10:28:04.045 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.043+0000 7f466a7e8700 1 Processor -- start 2022-09-17T10:28:04.046 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.043+0000 7f466a7e8700 1 -- start start 2022-09-17T10:28:04.049 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.044+0000 7f466a7e8700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46641751b0 0x7f4664180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.049 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.044+0000 7f466a7e8700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4664175590 0x7f4664180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.049 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.044+0000 7f466a7e8700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46640c6dd0 con 0x7f4664181050 2022-09-17T10:28:04.050 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.044+0000 7f466a7e8700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46640f10e0 con 0x7f46641751b0 2022-09-17T10:28:04.050 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.044+0000 7f466a7e8700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46640f0660 con 0x7f4664175590 2022-09-17T10:28:04.050 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f46637fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4664175590 0x7f4664180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.050 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f4663fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46641751b0 0x7f4664180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f4668d85700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f4664181050 0x7f4664181dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.62:40954/0 (socket says 172.21.15.62:40954) 2022-09-17T10:28:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f4668d85700 1 -- 172.21.15.62:0/2811187073 learned_addr learned my addr 172.21.15.62:0/2811187073 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f46637fe700 1 -- 172.21.15.62:0/2811187073 >> v2:172.21.15.93:3300/0 conn(0x7f46641751b0 msgr2=0x7f4664180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f46637fe700 1 --2- 172.21.15.62:0/2811187073 >> v2:172.21.15.93:3300/0 conn(0x7f46641751b0 0x7f4664180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f46637fe700 1 -- 172.21.15.62:0/2811187073 >> v1:172.21.15.159:6789/0 conn(0x7f4664181050 legacy=0x7f4664181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.052 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f4662ffd700 1 -- 172.21.15.62:0/2811187073 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055817706 0 0) 0x7f46640c6dd0 con 0x7f4664181050 2022-09-17T10:28:04.052 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f46637fe700 1 -- 172.21.15.62:0/2811187073 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46641801e0 con 0x7f4664175590 2022-09-17T10:28:04.052 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f46637fe700 1 --2- 172.21.15.62:0/2811187073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4664175590 0x7f4664180b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4664085780 tx=0x7f4654009060).ready entity=mon.2 client_cookie=51ffbabb907b4768 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.052 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f4662ffd700 1 -- 172.21.15.62:0/2811187073 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46540090d0 con 0x7f4664175590 2022-09-17T10:28:04.053 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f4662ffd700 1 -- 172.21.15.62:0/2811187073 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465400f510 con 0x7f4664175590 2022-09-17T10:28:04.053 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.045+0000 7f4662ffd700 1 -- 172.21.15.62:0/2811187073 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400f890 con 0x7f4664175590 2022-09-17T10:28:04.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.046+0000 7f466a7e8700 1 -- 172.21.15.62:0/2811187073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4664175590 msgr2=0x7f4664180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.046+0000 7f466a7e8700 1 --2- 172.21.15.62:0/2811187073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4664175590 0x7f4664180b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4664085780 tx=0x7f4654009060).stop 2022-09-17T10:28:04.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.046+0000 7f466a7e8700 1 -- 172.21.15.62:0/2811187073 shutdown_connections 2022-09-17T10:28:04.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.046+0000 7f466a7e8700 1 --2- 172.21.15.62:0/2811187073 >> v2:172.21.15.93:3300/0 conn(0x7f46641751b0 0x7f4664180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.055 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.046+0000 7f466a7e8700 1 --2- 172.21.15.62:0/2811187073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4664175590 0x7f4664180b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.055 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.046+0000 7f466a7e8700 1 -- 172.21.15.62:0/2811187073 >> 172.21.15.62:0/2811187073 conn(0x7f466406a170 msgr2=0x7f46640f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.055 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.046+0000 7f466a7e8700 1 -- 172.21.15.62:0/2811187073 shutdown_connections 2022-09-17T10:28:04.056 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.046+0000 7f466a7e8700 1 -- 172.21.15.62:0/2811187073 wait complete. 2022-09-17T10:28:04.056 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.047+0000 7f466a7e8700 1 Processor -- start 2022-09-17T10:28:04.056 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.047+0000 7f466a7e8700 1 -- start start 2022-09-17T10:28:04.060 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.048+0000 7f466a7e8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46641751b0 0x7f466417f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.060 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.048+0000 7f466a7e8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4664175590 0x7f46640caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.060 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.048+0000 7f466a7e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4664181050 0x7f46640cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.061 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.048+0000 7f466a7e8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640caa10 con 0x7f4664181050 2022-09-17T10:28:04.061 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.048+0000 7f466a7e8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640ca6c0 con 0x7f4664175590 2022-09-17T10:28:04.061 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.048+0000 7f466a7e8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4664086d50 con 0x7f46641751b0 2022-09-17T10:28:04.061 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4664181050 0x7f46640cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4664181050 0x7f46640cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49850/0 (socket says 172.21.15.62:49850) 2022-09-17T10:28:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 -- 172.21.15.62:0/3196796067 learned_addr learned my addr 172.21.15.62:0/3196796067 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4663fff700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46641751b0 0x7f466417f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f46637fe700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4664175590 0x7f46640caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 -- 172.21.15.62:0/3196796067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46641751b0 msgr2=0x7f466417f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46641751b0 0x7f466417f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 -- 172.21.15.62:0/3196796067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4664175590 msgr2=0x7f46640caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4664175590 0x7f46640caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 -- 172.21.15.62:0/3196796067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540092a0 con 0x7f4664181050 2022-09-17T10:28:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f4668d85700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4664181050 0x7f46640cb390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f465c00c730 tx=0x7f465c001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c005d30 con 0x7f4664181050 2022-09-17T10:28:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c005e90 con 0x7f4664181050 2022-09-17T10:28:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4664087030 con 0x7f4664181050 2022-09-17T10:28:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c007300 con 0x7f4664181050 2022-09-17T10:28:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.049+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46640875f0 con 0x7f4664181050 2022-09-17T10:28:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.050+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46640f1220 con 0x7f4664181050 2022-09-17T10:28:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.051+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f465c010070 con 0x7f4664181050 2022-09-17T10:28:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.051+0000 7f465bfff700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f464808ba40 0x7f464808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.052+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f465c0b0ad0 con 0x7f4664181050 2022-09-17T10:28:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.052+0000 7f4663fff700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f464808ba40 0x7f464808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.052+0000 7f465bfff700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.62:6808/81794,v1:172.21.15.62:6809/81794] conn(0x7f4648097420 0x7f46480998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.052+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 --> [v2:172.21.15.62:6808/81794,v1:172.21.15.62:6809/81794] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4648099f40 con 0x7f4648097420 2022-09-17T10:28:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.052+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f465c0b0dc0 con 0x7f4664181050 2022-09-17T10:28:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.052+0000 7f46637fe700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.62:6808/81794,v1:172.21.15.62:6809/81794] conn(0x7f4648097420 0x7f46480998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.052+0000 7f4663fff700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f464808ba40 0x7f464808df00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f464c009c30 tx=0x7f464c009060).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.052+0000 7f46637fe700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.62:6808/81794,v1:172.21.15.62:6809/81794] conn(0x7f4648097420 0x7f46480998c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.053+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 <== osd.9 v2:172.21.15.62:6808/81794 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f4648099f40 con 0x7f4648097420 2022-09-17T10:28:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.067+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 --> [v2:172.21.15.62:6808/81794,v1:172.21.15.62:6809/81794] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f466406bf40 con 0x7f4648097420 2022-09-17T10:28:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.067+0000 7f465bfff700 1 -- 172.21.15.62:0/3196796067 <== osd.9 v2:172.21.15.62:6808/81794 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f466406bf40 con 0x7f4648097420 2022-09-17T10:28:04.071 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 >> [v2:172.21.15.62:6808/81794,v1:172.21.15.62:6809/81794] conn(0x7f4648097420 msgr2=0x7f46480998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.071 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.62:6808/81794,v1:172.21.15.62:6809/81794] conn(0x7f4648097420 0x7f46480998c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.071 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f464808ba40 msgr2=0x7f464808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.071 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f464808ba40 0x7f464808df00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f464c009c30 tx=0x7f464c009060).stop 2022-09-17T10:28:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4664181050 msgr2=0x7f46640cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 --2- 172.21.15.62:0/3196796067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4664181050 0x7f46640cb390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f465c00c730 tx=0x7f465c001520).stop 2022-09-17T10:28:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f4668d85700 1 -- 172.21.15.62:0/3196796067 reap_dead start 2022-09-17T10:28:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 shutdown_connections 2022-09-17T10:28:04.073 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 >> 172.21.15.62:0/3196796067 conn(0x7f466406a170 msgr2=0x7f46641700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.073 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 shutdown_connections 2022-09-17T10:28:04.073 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.068+0000 7f466a7e8700 1 -- 172.21.15.62:0/3196796067 wait complete. 2022-09-17T10:28:04.082 INFO:teuthology.orchestra.run.smithi062.stdout:73014444042 2022-09-17T10:28:04.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2022-09-17T10:28:04.201 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.198+0000 7f24bc26b700 1 Processor -- start 2022-09-17T10:28:04.201 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.198+0000 7f24bc26b700 1 -- start start 2022-09-17T10:28:04.210 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.199+0000 7f24bc26b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f24b4174ff0 0x7f24b4063d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.210 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.199+0000 7f24bc26b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b4175470 con 0x7f24b4174c10 2022-09-17T10:28:04.211 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.199+0000 7f24bc26b700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b40641f0 con 0x7f24b417d490 2022-09-17T10:28:04.211 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.199+0000 7f24bc26b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b417c110 con 0x7f24b4174ff0 2022-09-17T10:28:04.211 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24ba007700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f24b4174c10 0x7f24b40635f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57734/0 (socket says 172.21.15.62:57734) 2022-09-17T10:28:04.212 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24ba007700 1 -- 172.21.15.62:0/2533615463 learned_addr learned my addr 172.21.15.62:0/2533615463 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:04.212 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9806700 1 --2- 172.21.15.62:0/2533615463 >> v2:172.21.15.93:3300/0 conn(0x7f24b4174ff0 0x7f24b4063d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.213 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710119058 0 0) 0x7f24b4175470 con 0x7f24b4174c10 2022-09-17T10:28:04.213 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a00033f0 con 0x7f24b4174c10 2022-09-17T10:28:04.213 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347481237 0 0) 0x7f24b40641f0 con 0x7f24b417d490 2022-09-17T10:28:04.214 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b4175470 con 0x7f24b417d490 2022-09-17T10:28:04.214 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 404033690 0 0) 0x7f24a00033f0 con 0x7f24b4174c10 2022-09-17T10:28:04.214 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 >> v2:172.21.15.93:3300/0 conn(0x7f24b4174ff0 msgr2=0x7f24b4063d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:04.214 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 --2- 172.21.15.62:0/2533615463 >> v2:172.21.15.93:3300/0 conn(0x7f24b4174ff0 0x7f24b4063d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.215 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 >> v1:172.21.15.159:6789/0 conn(0x7f24b417d490 legacy=0x7f24b417d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.215 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b417c3f0 con 0x7f24b4174c10 2022-09-17T10:28:04.215 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f24ac001470 con 0x7f24b4174c10 2022-09-17T10:28:04.215 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 >> v1:172.21.15.62:6789/0 conn(0x7f24b4174c10 legacy=0x7f24b40635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.216 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24a0003ac0 0x7f24a0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.216 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.216 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a0005000 0x7f24a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.216 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b417c110 con 0x7f24a0004690 2022-09-17T10:28:04.217 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a000beb0 con 0x7f24a0003ac0 2022-09-17T10:28:04.217 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a000c070 con 0x7f24a0005000 2022-09-17T10:28:04.217 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24b9806700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.217 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24ba007700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24a0003ac0 0x7f24a0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.218 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.200+0000 7f24ba808700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a0005000 0x7f24a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.218 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9806700 1 -- 172.21.15.62:0/2533615463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a0005000 msgr2=0x7f24a000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:04.219 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9806700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a0005000 0x7f24a000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.219 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9806700 1 -- 172.21.15.62:0/2533615463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24a0003ac0 msgr2=0x7f24a0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:04.219 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9806700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24a0003ac0 0x7f24a0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.219 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9806700 1 -- 172.21.15.62:0/2533615463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00033f0 con 0x7f24a0004690 2022-09-17T10:28:04.220 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24ba007700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24a0003ac0 0x7f24a0003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:04.220 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24ba808700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a0005000 0x7f24a000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:04.220 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24ba808700 1 -- 172.21.15.62:0/2533615463 reap_dead start 2022-09-17T10:28:04.220 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9806700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f24a8009a80 tx=0x7f24a8009060).ready entity=mon.0 client_cookie=b35838dd7c9c8dae server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.221 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8009430 con 0x7f24a0004690 2022-09-17T10:28:04.221 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a800e640 con 0x7f24a0004690 2022-09-17T10:28:04.221 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24b9005700 1 -- 172.21.15.62:0/2533615463 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800e9c0 con 0x7f24a0004690 2022-09-17T10:28:04.221 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24bc26b700 1 -- 172.21.15.62:0/2533615463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 msgr2=0x7f24a0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.222 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24bc26b700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f24a8009a80 tx=0x7f24a8009060).stop 2022-09-17T10:28:04.222 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.201+0000 7f24bc26b700 1 -- 172.21.15.62:0/2533615463 shutdown_connections 2022-09-17T10:28:04.222 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.202+0000 7f24bc26b700 1 --2- 172.21.15.62:0/2533615463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24a0004b10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.222 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.202+0000 7f24bc26b700 1 -- 172.21.15.62:0/2533615463 >> 172.21.15.62:0/2533615463 conn(0x7f24b40f4c90 msgr2=0x7f24b40f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.223 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.202+0000 7f24bc26b700 1 -- 172.21.15.62:0/2533615463 shutdown_connections 2022-09-17T10:28:04.223 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.202+0000 7f24bc26b700 1 -- 172.21.15.62:0/2533615463 wait complete. 2022-09-17T10:28:04.223 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.203+0000 7f24bc26b700 1 Processor -- start 2022-09-17T10:28:04.223 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.203+0000 7f24bc26b700 1 -- start start 2022-09-17T10:28:04.224 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24bc26b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24b418f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.224 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24bc26b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24b416b290 0x7f24b418fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.224 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24bc26b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24b4168380 0x7f24b41687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.224 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24bc26b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b416ae00 con 0x7f24a0004690 2022-09-17T10:28:04.225 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24bc26b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b416a510 con 0x7f24b416b290 2022-09-17T10:28:04.225 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24bc26b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b418f010 con 0x7f24b4168380 2022-09-17T10:28:04.225 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24b418f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.225 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24b418f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49870/0 (socket says 172.21.15.62:49870) 2022-09-17T10:28:04.226 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 -- 172.21.15.62:0/1513549382 learned_addr learned my addr 172.21.15.62:0/1513549382 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:04.226 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 -- 172.21.15.62:0/1513549382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24b4168380 msgr2=0x7f24b41687e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.226 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24b4168380 0x7f24b41687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:04.226 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 -- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24b416b290 msgr2=0x7f24b418fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.227 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24b416b290 0x7f24b418fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:04.227 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 -- 172.21.15.62:0/1513549382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b418f2f0 con 0x7f24a0004690 2022-09-17T10:28:04.227 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24ba007700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24b418f910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f24ac0010e0 tx=0x7f24ac001d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.227 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.204+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac010520 con 0x7f24a0004690 2022-09-17T10:28:04.228 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.205+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac010680 con 0x7f24a0004690 2022-09-17T10:28:04.228 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.205+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b416a7b0 con 0x7f24a0004690 2022-09-17T10:28:04.228 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.205+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac010a00 con 0x7f24a0004690 2022-09-17T10:28:04.228 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.205+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b418e440 con 0x7f24a0004690 2022-09-17T10:28:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.205+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24b406bf40 con 0x7f24a0004690 2022-09-17T10:28:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.206+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f24ac024070 con 0x7f24a0004690 2022-09-17T10:28:04.230 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.207+0000 7f24b27fc700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f249408ba40 0x7f249408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.230 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.207+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f24ac0b0e40 con 0x7f24a0004690 2022-09-17T10:28:04.230 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.207+0000 7f24b27fc700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6816/81644,v1:172.21.15.93:6817/81644] conn(0x7f2494097420 0x7f24940998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.230 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.207+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 --> [v2:172.21.15.93:6816/81644,v1:172.21.15.93:6817/81644] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2494099f40 con 0x7f2494097420 2022-09-17T10:28:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.207+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24ac0b11b0 con 0x7f24a0004690 2022-09-17T10:28:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.207+0000 7f24b9806700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f249408ba40 0x7f249408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.207+0000 7f24ba808700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6816/81644,v1:172.21.15.93:6817/81644] conn(0x7f2494097420 0x7f24940998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.231 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.208+0000 7f24b9806700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f249408ba40 0x7f249408df00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f24b4153950 tx=0x7f24a801a000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.208+0000 7f24ba808700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6816/81644,v1:172.21.15.93:6817/81644] conn(0x7f2494097420 0x7f24940998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.208+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 <== osd.10 v2:172.21.15.93:6816/81644 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2494099f40 con 0x7f2494097420 2022-09-17T10:28:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 --> [v2:172.21.15.93:6816/81644,v1:172.21.15.93:6817/81644] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24b416af40 con 0x7f2494097420 2022-09-17T10:28:04.234 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24b27fc700 1 -- 172.21.15.62:0/1513549382 <== osd.10 v2:172.21.15.93:6816/81644 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f24a4003090 con 0x7f2494097420 2022-09-17T10:28:04.235 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6816/81644,v1:172.21.15.93:6817/81644] conn(0x7f2494097420 msgr2=0x7f24940998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.236 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6816/81644,v1:172.21.15.93:6817/81644] conn(0x7f2494097420 0x7f24940998c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.236 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f249408ba40 msgr2=0x7f249408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.236 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f249408ba40 0x7f249408df00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f24b4153950 tx=0x7f24a801a000).stop 2022-09-17T10:28:04.236 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 msgr2=0x7f24b418f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.237 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 --2- 172.21.15.62:0/1513549382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a0004690 0x7f24b418f910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f24ac0010e0 tx=0x7f24ac001d50).stop 2022-09-17T10:28:04.237 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24ba808700 1 -- 172.21.15.62:0/1513549382 reap_dead start 2022-09-17T10:28:04.237 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 shutdown_connections 2022-09-17T10:28:04.237 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 >> 172.21.15.62:0/1513549382 conn(0x7f24b40f4c90 msgr2=0x7f24b417dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.238 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 shutdown_connections 2022-09-17T10:28:04.238 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.223+0000 7f24bc26b700 1 -- 172.21.15.62:0/1513549382 wait complete. 2022-09-17T10:28:04.240 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:04.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2022-09-17T10:28:04.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.357+0000 7f4eef7f5700 1 Processor -- start 2022-09-17T10:28:04.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.357+0000 7f4eef7f5700 1 -- start start 2022-09-17T10:28:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eef7f5700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4ee81751b0 0x7f4ee8180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eef7f5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ee8175590 0x7f4ee8180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eef7f5700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee80c6dd0 con 0x7f4ee8181050 2022-09-17T10:28:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eef7f5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee80f10e0 con 0x7f4ee8175590 2022-09-17T10:28:04.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eef7f5700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee80f0660 con 0x7f4ee81751b0 2022-09-17T10:28:04.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eecd90700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ee8175590 0x7f4ee8180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.365 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eecd90700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ee8175590 0x7f4ee8180b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49872/0 (socket says 172.21.15.62:49872) 2022-09-17T10:28:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eecd90700 1 -- 172.21.15.62:0/611631489 learned_addr learned my addr 172.21.15.62:0/611631489 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eed591700 1 --2- 172.21.15.62:0/611631489 >> v2:172.21.15.159:3300/0 conn(0x7f4ee81751b0 0x7f4ee8180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eecd90700 1 -- 172.21.15.62:0/611631489 >> v2:172.21.15.159:3300/0 conn(0x7f4ee81751b0 msgr2=0x7f4ee8180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.358+0000 7f4eecd90700 1 --2- 172.21.15.62:0/611631489 >> v2:172.21.15.159:3300/0 conn(0x7f4ee81751b0 0x7f4ee8180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eecd90700 1 -- 172.21.15.62:0/611631489 >> v1:172.21.15.93:6789/0 conn(0x7f4ee8181050 legacy=0x7f4ee8181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eecd90700 1 -- 172.21.15.62:0/611631489 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee81801e0 con 0x7f4ee8175590 2022-09-17T10:28:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eecd90700 1 --2- 172.21.15.62:0/611631489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 0x7f4ee8180b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f4ee8088880 tx=0x7f4ed80090f0).ready entity=mon.0 client_cookie=c9ef7755e94ce07c server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4ed7fff700 1 -- 172.21.15.62:0/611631489 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800b600 con 0x7f4ee8175590 2022-09-17T10:28:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4ed7fff700 1 -- 172.21.15.62:0/611631489 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800b760 con 0x7f4ee8175590 2022-09-17T10:28:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4ed7fff700 1 -- 172.21.15.62:0/611631489 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800bb00 con 0x7f4ee8175590 2022-09-17T10:28:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eef7f5700 1 -- 172.21.15.62:0/611631489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 msgr2=0x7f4ee8180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eef7f5700 1 --2- 172.21.15.62:0/611631489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 0x7f4ee8180b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f4ee8088880 tx=0x7f4ed80090f0).stop 2022-09-17T10:28:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eef7f5700 1 -- 172.21.15.62:0/611631489 shutdown_connections 2022-09-17T10:28:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eef7f5700 1 --2- 172.21.15.62:0/611631489 >> v2:172.21.15.159:3300/0 conn(0x7f4ee81751b0 0x7f4ee8180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eef7f5700 1 --2- 172.21.15.62:0/611631489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 0x7f4ee8180b60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eef7f5700 1 -- 172.21.15.62:0/611631489 >> 172.21.15.62:0/611631489 conn(0x7f4ee806a170 msgr2=0x7f4ee80f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eef7f5700 1 -- 172.21.15.62:0/611631489 shutdown_connections 2022-09-17T10:28:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.359+0000 7f4eef7f5700 1 -- 172.21.15.62:0/611631489 wait complete. 2022-09-17T10:28:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.361+0000 7f4eef7f5700 1 Processor -- start 2022-09-17T10:28:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.361+0000 7f4eef7f5700 1 -- start start 2022-09-17T10:28:04.374 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eef7f5700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee81751b0 0x7f4ee8088100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eef7f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 0x7f4ee816fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eef7f5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ee8181050 0x7f4ee8175990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eef7f5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8087c70 con 0x7f4ee8175590 2022-09-17T10:28:04.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eef7f5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8087060 con 0x7f4ee8181050 2022-09-17T10:28:04.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eef7f5700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8087340 con 0x7f4ee81751b0 2022-09-17T10:28:04.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eecd90700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 0x7f4ee816fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eecd90700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 0x7f4ee816fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49886/0 (socket says 172.21.15.62:49886) 2022-09-17T10:28:04.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eecd90700 1 -- 172.21.15.62:0/1143419759 learned_addr learned my addr 172.21.15.62:0/1143419759 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:04.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eed591700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee81751b0 0x7f4ee8088100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eedd92700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ee8181050 0x7f4ee8175990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eecd90700 1 -- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee81751b0 msgr2=0x7f4ee8088100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eecd90700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee81751b0 0x7f4ee8088100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eecd90700 1 -- 172.21.15.62:0/1143419759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ee8181050 msgr2=0x7f4ee8175990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eecd90700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ee8181050 0x7f4ee8175990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eecd90700 1 -- 172.21.15.62:0/1143419759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009370 con 0x7f4ee8175590 2022-09-17T10:28:04.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.362+0000 7f4eed591700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee81751b0 0x7f4ee8088100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:04.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.363+0000 7f4eecd90700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 0x7f4ee816fed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f4ee8088960 tx=0x7f4ed8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.363+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800bec0 con 0x7f4ee8175590 2022-09-17T10:28:04.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.363+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800b8d0 con 0x7f4ee8175590 2022-09-17T10:28:04.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.363+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8087620 con 0x7f4ee8175590 2022-09-17T10:28:04.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.363+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8024470 con 0x7f4ee8175590 2022-09-17T10:28:04.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.363+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee81703c0 con 0x7f4ee8175590 2022-09-17T10:28:04.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.364+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ee81705b0 con 0x7f4ee8175590 2022-09-17T10:28:04.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.365+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4ed800f070 con 0x7f4ee8175590 2022-09-17T10:28:04.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.365+0000 7f4ed57fa700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ec808ba40 0x7f4ec808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.365+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f4ed80b24c0 con 0x7f4ee8175590 2022-09-17T10:28:04.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.365+0000 7f4eed591700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ec808ba40 0x7f4ec808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.365+0000 7f4ed57fa700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:6816/81905,v1:172.21.15.159:6817/81905] conn(0x7f4ec8097420 0x7f4ec80998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.365+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 --> [v2:172.21.15.159:6816/81905,v1:172.21.15.159:6817/81905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ec8099f40 con 0x7f4ec8097420 2022-09-17T10:28:04.382 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.365+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ed80b4aa0 con 0x7f4ee8175590 2022-09-17T10:28:04.382 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.366+0000 7f4eedd92700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:6816/81905,v1:172.21.15.159:6817/81905] conn(0x7f4ec8097420 0x7f4ec80998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.382 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.366+0000 7f4eed591700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ec808ba40 0x7f4ec808df00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4ee400bb60 tx=0x7f4ee4008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.382 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.366+0000 7f4eedd92700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:6816/81905,v1:172.21.15.159:6817/81905] conn(0x7f4ec8097420 0x7f4ec80998c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.382 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.367+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 <== osd.11 v2:172.21.15.159:6816/81905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f4ec8099f40 con 0x7f4ec8097420 2022-09-17T10:28:04.383 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.381+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 --> [v2:172.21.15.159:6816/81905,v1:172.21.15.159:6817/81905] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ee8087ac0 con 0x7f4ec8097420 2022-09-17T10:28:04.384 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4ed57fa700 1 -- 172.21.15.62:0/1143419759 <== osd.11 v2:172.21.15.159:6816/81905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4ee8087ac0 con 0x7f4ec8097420 2022-09-17T10:28:04.385 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:6816/81905,v1:172.21.15.159:6817/81905] conn(0x7f4ec8097420 msgr2=0x7f4ec80998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.385 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.159:6816/81905,v1:172.21.15.159:6817/81905] conn(0x7f4ec8097420 0x7f4ec80998c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.386 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ec808ba40 msgr2=0x7f4ec808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.386 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ec808ba40 0x7f4ec808df00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4ee400bb60 tx=0x7f4ee4008040).stop 2022-09-17T10:28:04.386 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 msgr2=0x7f4ee816fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.386 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 --2- 172.21.15.62:0/1143419759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee8175590 0x7f4ee816fed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f4ee8088960 tx=0x7f4ed8017000).stop 2022-09-17T10:28:04.387 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eedd92700 1 -- 172.21.15.62:0/1143419759 reap_dead start 2022-09-17T10:28:04.387 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 shutdown_connections 2022-09-17T10:28:04.387 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 >> 172.21.15.62:0/1143419759 conn(0x7f4ee806a170 msgr2=0x7f4ee80835c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.387 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 shutdown_connections 2022-09-17T10:28:04.388 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.382+0000 7f4eef7f5700 1 -- 172.21.15.62:0/1143419759 wait complete. 2022-09-17T10:28:04.396 INFO:teuthology.orchestra.run.smithi062.stdout:73014444042 2022-09-17T10:28:04.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-09-17T10:28:04.514 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.512+0000 7f7db20a4700 1 Processor -- start 2022-09-17T10:28:04.515 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.512+0000 7f7db20a4700 1 -- start start 2022-09-17T10:28:04.518 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.513+0000 7f7db20a4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7dac17dcd0 0x7f7dac17e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.513+0000 7f7db20a4700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7dac17f070 0x7f7dac0e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.513+0000 7f7db20a4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac0e6130 con 0x7f7dac17ebf0 2022-09-17T10:28:04.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.513+0000 7f7db20a4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac0ecc10 con 0x7f7dac17dcd0 2022-09-17T10:28:04.519 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.513+0000 7f7db20a4700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac0eb860 con 0x7f7dac17f070 2022-09-17T10:28:04.520 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.513+0000 7f7db08a1700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7dac17ebf0 0x7f7dac0e5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57750/0 (socket says 172.21.15.62:57750) 2022-09-17T10:28:04.520 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.513+0000 7f7db08a1700 1 -- 172.21.15.62:0/253676736 learned_addr learned my addr 172.21.15.62:0/253676736 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:04.520 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7db18a3700 1 --2- 172.21.15.62:0/253676736 >> v2:172.21.15.159:3300/0 conn(0x7f7dac17f070 0x7f7dac0e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.520 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7db10a2700 1 --2- 172.21.15.62:0/253676736 >> v2:172.21.15.93:3300/0 conn(0x7f7dac17dcd0 0x7f7dac17e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7dabfff700 1 -- 172.21.15.62:0/253676736 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522052125 0 0) 0x7f7dac0e6130 con 0x7f7dac17ebf0 2022-09-17T10:28:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7dabfff700 1 -- 172.21.15.62:0/253676736 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d980033f0 con 0x7f7dac17ebf0 2022-09-17T10:28:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7dabfff700 1 -- 172.21.15.62:0/253676736 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1265693696 0 0) 0x7f7d980033f0 con 0x7f7dac17ebf0 2022-09-17T10:28:04.522 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7db18a3700 1 -- 172.21.15.62:0/253676736 >> v2:172.21.15.93:3300/0 conn(0x7f7dac17dcd0 msgr2=0x7f7dac17e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:04.522 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7db18a3700 1 --2- 172.21.15.62:0/253676736 >> v2:172.21.15.93:3300/0 conn(0x7f7dac17dcd0 0x7f7dac17e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.522 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7db18a3700 1 -- 172.21.15.62:0/253676736 >> v1:172.21.15.62:6789/0 conn(0x7f7dac17ebf0 legacy=0x7f7dac0e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7db18a3700 1 -- 172.21.15.62:0/253676736 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0e50a0 con 0x7f7dac17f070 2022-09-17T10:28:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7db18a3700 1 --2- 172.21.15.62:0/253676736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 0x7f7dac0e5c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f7dac0bce50 tx=0x7f7d9c009060).ready entity=mon.2 client_cookie=1d65758f6a7cc9c9 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7dabfff700 1 -- 172.21.15.62:0/253676736 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da00017f0 con 0x7f7dac17f070 2022-09-17T10:28:04.524 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7dabfff700 1 -- 172.21.15.62:0/253676736 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c0090d0 con 0x7f7dac17f070 2022-09-17T10:28:04.524 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.514+0000 7f7dabfff700 1 -- 172.21.15.62:0/253676736 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c011610 con 0x7f7dac17f070 2022-09-17T10:28:04.524 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.515+0000 7f7db20a4700 1 -- 172.21.15.62:0/253676736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 msgr2=0x7f7dac0e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.525 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.515+0000 7f7db20a4700 1 --2- 172.21.15.62:0/253676736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 0x7f7dac0e5c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f7dac0bce50 tx=0x7f7d9c009060).stop 2022-09-17T10:28:04.525 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.515+0000 7f7db20a4700 1 -- 172.21.15.62:0/253676736 shutdown_connections 2022-09-17T10:28:04.525 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.515+0000 7f7db20a4700 1 --2- 172.21.15.62:0/253676736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 0x7f7dac0e5c40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.525 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.515+0000 7f7db20a4700 1 --2- 172.21.15.62:0/253676736 >> v2:172.21.15.93:3300/0 conn(0x7f7dac17dcd0 0x7f7dac17e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.526 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.515+0000 7f7db20a4700 1 -- 172.21.15.62:0/253676736 >> 172.21.15.62:0/253676736 conn(0x7f7dac0de5f0 msgr2=0x7f7dac05d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.526 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.515+0000 7f7db20a4700 1 -- 172.21.15.62:0/253676736 shutdown_connections 2022-09-17T10:28:04.526 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.515+0000 7f7db20a4700 1 -- 172.21.15.62:0/253676736 wait complete. 2022-09-17T10:28:04.526 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.516+0000 7f7db20a4700 1 Processor -- start 2022-09-17T10:28:04.527 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.516+0000 7f7db20a4700 1 -- start start 2022-09-17T10:28:04.530 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.517+0000 7f7db20a4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dac17dcd0 0x7f7dac1796a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.531 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.517+0000 7f7db20a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dac17ebf0 0x7f7dac1748d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.531 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.517+0000 7f7db20a4700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 0x7f7dac174dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.531 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.517+0000 7f7db20a4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0bab90 con 0x7f7dac17ebf0 2022-09-17T10:28:04.531 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.517+0000 7f7db20a4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0ba2d0 con 0x7f7dac17dcd0 2022-09-17T10:28:04.532 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.517+0000 7f7db20a4700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0e7d30 con 0x7f7dac17f070 2022-09-17T10:28:04.532 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dac17ebf0 0x7f7dac1748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.532 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dac17ebf0 0x7f7dac1748d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49898/0 (socket says 172.21.15.62:49898) 2022-09-17T10:28:04.532 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 -- 172.21.15.62:0/82069281 learned_addr learned my addr 172.21.15.62:0/82069281 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:04.533 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db10a2700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dac17dcd0 0x7f7dac1796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.533 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db18a3700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 0x7f7dac174dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.533 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 -- 172.21.15.62:0/82069281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 msgr2=0x7f7dac174dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.533 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 0x7f7dac174dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.534 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 -- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dac17dcd0 msgr2=0x7f7dac1796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.534 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dac17dcd0 0x7f7dac1796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.534 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 -- 172.21.15.62:0/82069281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0092a0 con 0x7f7dac17ebf0 2022-09-17T10:28:04.535 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db08a1700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dac17ebf0 0x7f7dac1748d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f7da000cbc0 tx=0x7f7da0001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.535 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7da97fa700 1 -- 172.21.15.62:0/82069281 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da0004c40 con 0x7f7dac17ebf0 2022-09-17T10:28:04.535 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7da97fa700 1 -- 172.21.15.62:0/82069281 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da0004dc0 con 0x7f7dac17ebf0 2022-09-17T10:28:04.536 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac0ba540 con 0x7f7dac17ebf0 2022-09-17T10:28:04.536 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7da97fa700 1 -- 172.21.15.62:0/82069281 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da00073c0 con 0x7f7dac17ebf0 2022-09-17T10:28:04.536 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.518+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac0e8010 con 0x7f7dac17ebf0 2022-09-17T10:28:04.536 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.519+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac0bad40 con 0x7f7dac17ebf0 2022-09-17T10:28:04.537 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.520+0000 7f7da97fa700 1 -- 172.21.15.62:0/82069281 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f7da001b060 con 0x7f7dac17ebf0 2022-09-17T10:28:04.537 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.520+0000 7f7da97fa700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7d8c08ba40 0x7f7d8c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.537 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.521+0000 7f7da97fa700 1 -- 172.21.15.62:0/82069281 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7da00b05a0 con 0x7f7dac17ebf0 2022-09-17T10:28:04.537 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.521+0000 7f7db10a2700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7d8c08ba40 0x7f7d8c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.538 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.521+0000 7f7db10a2700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7d8c08ba40 0x7f7d8c08df00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f7da4009b90 tx=0x7f7da4009060).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.538 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.524+0000 7f7da97fa700 1 -- 172.21.15.62:0/82069281 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f7dac0bad40 con 0x7f7dac17ebf0 2022-09-17T10:28:04.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.696+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7dac06bf00 con 0x7f7dac17ebf0 2022-09-17T10:28:04.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.696+0000 7f7da97fa700 1 -- 172.21.15.62:0/82069281 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7da0019020 con 0x7f7dac17ebf0 2022-09-17T10:28:04.699 INFO:teuthology.orchestra.run.smithi062.stdout:73014444040 2022-09-17T10:28:04.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7d8c08ba40 msgr2=0x7f7d8c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7d8c08ba40 0x7f7d8c08df00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f7da4009b90 tx=0x7f7da4009060).stop 2022-09-17T10:28:04.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dac17ebf0 msgr2=0x7f7dac1748d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dac17ebf0 0x7f7dac1748d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f7da000cbc0 tx=0x7f7da0001d90).stop 2022-09-17T10:28:04.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 shutdown_connections 2022-09-17T10:28:04.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f7d8c08ba40 0x7f7d8c08df00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dac17dcd0 0x7f7dac1796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dac17f070 0x7f7dac174dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 --2- 172.21.15.62:0/82069281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dac17ebf0 0x7f7dac1748d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 >> 172.21.15.62:0/82069281 conn(0x7f7dac0de5f0 msgr2=0x7f7dac177b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 shutdown_connections 2022-09-17T10:28:04.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.698+0000 7f7db20a4700 1 -- 172.21.15.62:0/82069281 wait complete. 2022-09-17T10:28:04.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.0 2022-09-17T10:28:04.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-09-17T10:28:04.829 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.827+0000 7f4bc2be0700 1 Processor -- start 2022-09-17T10:28:04.830 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.827+0000 7f4bc2be0700 1 -- start start 2022-09-17T10:28:04.834 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc2be0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bbc175110 0x7f4bbc0f0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.834 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc2be0700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4bbc0cb5e0 0x7f4bbc184e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.835 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc2be0700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc0cce00 con 0x7f4bbc17c190 2022-09-17T10:28:04.835 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc2be0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc1754f0 con 0x7f4bbc175110 2022-09-17T10:28:04.836 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc2be0700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc0cbf10 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.836 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc097c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bbc175110 0x7f4bbc0f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc097c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bbc175110 0x7f4bbc0f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49904/0 (socket says 172.21.15.62:49904) 2022-09-17T10:28:04.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc097c700 1 -- 172.21.15.62:0/2762435310 learned_addr learned my addr 172.21.15.62:0/2762435310 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:04.837 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc117d700 1 --2- 172.21.15.62:0/2762435310 >> v2:172.21.15.93:3300/0 conn(0x7f4bbc0cb5e0 0x7f4bbc184e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.838 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc097c700 1 -- 172.21.15.62:0/2762435310 >> v2:172.21.15.93:3300/0 conn(0x7f4bbc0cb5e0 msgr2=0x7f4bbc184e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:04.838 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc097c700 1 --2- 172.21.15.62:0/2762435310 >> v2:172.21.15.93:3300/0 conn(0x7f4bbc0cb5e0 0x7f4bbc184e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc097c700 1 -- 172.21.15.62:0/2762435310 >> v1:172.21.15.93:6789/0 conn(0x7f4bbc17c190 legacy=0x7f4bbc0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:04.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc097c700 1 -- 172.21.15.62:0/2762435310 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc0cc1f0 con 0x7f4bbc175110 2022-09-17T10:28:04.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc117d700 1 --2- 172.21.15.62:0/2762435310 >> v2:172.21.15.93:3300/0 conn(0x7f4bbc0cb5e0 0x7f4bbc184e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:04.839 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bc097c700 1 --2- 172.21.15.62:0/2762435310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc175110 0x7f4bbc0f0890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f4bbc0899d0 tx=0x7f4bb40090f0).ready entity=mon.0 client_cookie=5f93d131c4c87717 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.840 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bbb7fe700 1 -- 172.21.15.62:0/2762435310 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400b5a0 con 0x7f4bbc175110 2022-09-17T10:28:04.840 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bbb7fe700 1 -- 172.21.15.62:0/2762435310 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb400b700 con 0x7f4bbc175110 2022-09-17T10:28:04.840 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.829+0000 7f4bbb7fe700 1 -- 172.21.15.62:0/2762435310 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400ba80 con 0x7f4bbc175110 2022-09-17T10:28:04.840 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.830+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2762435310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc175110 msgr2=0x7f4bbc0f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.830+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2762435310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc175110 0x7f4bbc0f0890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f4bbc0899d0 tx=0x7f4bb40090f0).stop 2022-09-17T10:28:04.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.830+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2762435310 shutdown_connections 2022-09-17T10:28:04.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.830+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2762435310 >> v2:172.21.15.93:3300/0 conn(0x7f4bbc0cb5e0 0x7f4bbc184e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.841 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.830+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2762435310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc175110 0x7f4bbc0f0890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.842 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.830+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2762435310 >> 172.21.15.62:0/2762435310 conn(0x7f4bbc06a110 msgr2=0x7f4bbc0f4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:04.842 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.830+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2762435310 shutdown_connections 2022-09-17T10:28:04.842 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.830+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2762435310 wait complete. 2022-09-17T10:28:04.843 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.831+0000 7f4bc2be0700 1 Processor -- start 2022-09-17T10:28:04.843 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.831+0000 7f4bc2be0700 1 -- start start 2022-09-17T10:28:04.847 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.832+0000 7f4bc2be0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0cb5e0 0x7f4bbc170f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.847 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.832+0000 7f4bc2be0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4bbc175110 0x7f4bbc18fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.847 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.832+0000 7f4bc2be0700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc17c190 0x7f4bbc1901d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.847 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.832+0000 7f4bc2be0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc171420 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.848 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.832+0000 7f4bc2be0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc191880 con 0x7f4bbc175110 2022-09-17T10:28:04.848 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.832+0000 7f4bc2be0700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1906c0 con 0x7f4bbc17c190 2022-09-17T10:28:04.848 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0cb5e0 0x7f4bbc170f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.848 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0cb5e0 0x7f4bbc170f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49908/0 (socket says 172.21.15.62:49908) 2022-09-17T10:28:04.849 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 -- 172.21.15.62:0/2533575350 learned_addr learned my addr 172.21.15.62:0/2533575350 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:04.849 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bbbfff700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4bbc175110 0x7f4bbc18fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.849 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc117d700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc17c190 0x7f4bbc1901d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.849 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 -- 172.21.15.62:0/2533575350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc17c190 msgr2=0x7f4bbc1901d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.849 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc17c190 0x7f4bbc1901d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.850 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 -- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4bbc175110 msgr2=0x7f4bbc18fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:04.850 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4bbc175110 0x7f4bbc18fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:04.850 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 -- 172.21.15.62:0/2533575350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4009370 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.850 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc117d700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc17c190 0x7f4bbc1901d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:04.851 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc097c700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0cb5e0 0x7f4bbc170f30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f4bb4009130 tx=0x7f4bb4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.851 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bb8ff9700 1 -- 172.21.15.62:0/2533575350 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400b870 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.851 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bb8ff9700 1 -- 172.21.15.62:0/2533575350 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb400b9d0 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.851 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bb8ff9700 1 -- 172.21.15.62:0/2533575350 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb401b660 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.852 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc190990 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.852 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.833+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc190f50 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.852 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.834+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc191b60 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.852 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.835+0000 7f4bb8ff9700 1 -- 172.21.15.62:0/2533575350 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4bb400f070 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.852 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.835+0000 7f4bb8ff9700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ba008ba40 0x7f4ba008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:04.853 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.835+0000 7f4bb8ff9700 1 -- 172.21.15.62:0/2533575350 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f4bb40b1cd0 con 0x7f4bbc0cb5e0 2022-09-17T10:28:04.853 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.836+0000 7f4bbbfff700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ba008ba40 0x7f4ba008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:04.853 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.836+0000 7f4bbbfff700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ba008ba40 0x7f4ba008df00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4bbc18f950 tx=0x7f4bac009250).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:04.853 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:04.839+0000 7f4bb8ff9700 1 -- 172.21.15.62:0/2533575350 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f4bb4082a10 con 0x7f4bbc0cb5e0 2022-09-17T10:28:05.015 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.013+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4bbc06bf40 con 0x7f4bbc0cb5e0 2022-09-17T10:28:05.016 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.013+0000 7f4bb8ff9700 1 -- 172.21.15.62:0/2533575350 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bb4086030 con 0x7f4bbc0cb5e0 2022-09-17T10:28:05.017 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:05.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ba008ba40 msgr2=0x7f4ba008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ba008ba40 0x7f4ba008df00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4bbc18f950 tx=0x7f4bac009250).stop 2022-09-17T10:28:05.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0cb5e0 msgr2=0x7f4bbc170f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0cb5e0 0x7f4bbc170f30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f4bb4009130 tx=0x7f4bb4015000).stop 2022-09-17T10:28:05.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 shutdown_connections 2022-09-17T10:28:05.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ba008ba40 0x7f4ba008df00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.020 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc17c190 0x7f4bbc1901d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0cb5e0 0x7f4bbc170f30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 --2- 172.21.15.62:0/2533575350 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4bbc175110 0x7f4bbc18fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 >> 172.21.15.62:0/2533575350 conn(0x7f4bbc06a110 msgr2=0x7f4bbc158930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:05.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 shutdown_connections 2022-09-17T10:28:05.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.015+0000 7f4bc2be0700 1 -- 172.21.15.62:0/2533575350 wait complete. 2022-09-17T10:28:05.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.1 2022-09-17T10:28:05.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-09-17T10:28:05.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.147+0000 7f2878d57700 1 Processor -- start 2022-09-17T10:28:05.150 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.147+0000 7f2878d57700 1 -- start start 2022-09-17T10:28:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2878d57700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2874175590 0x7f2874180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2878d57700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740c6dd0 con 0x7f28741751b0 2022-09-17T10:28:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2878d57700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28741801e0 con 0x7f28740ef650 2022-09-17T10:28:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2878d57700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28740f10e0 con 0x7f2874175590 2022-09-17T10:28:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2871d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2874175590 0x7f2874180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f287259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f28741751b0 0x7f2874180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57756/0 (socket says 172.21.15.62:57756) 2022-09-17T10:28:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f287259c700 1 -- 172.21.15.62:0/2671982300 learned_addr learned my addr 172.21.15.62:0/2671982300 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2871d9b700 1 -- 172.21.15.62:0/2671982300 >> v1:172.21.15.159:6789/0 conn(0x7f28740ef650 legacy=0x7f28740efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2871d9b700 1 -- 172.21.15.62:0/2671982300 >> v1:172.21.15.62:6789/0 conn(0x7f28741751b0 legacy=0x7f2874180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f287159a700 1 -- 172.21.15.62:0/2671982300 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516378219 0 0) 0x7f28740c6dd0 con 0x7f28741751b0 2022-09-17T10:28:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2871d9b700 1 -- 172.21.15.62:0/2671982300 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740f0840 con 0x7f2874175590 2022-09-17T10:28:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f2871d9b700 1 --2- 172.21.15.62:0/2671982300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2874175590 0x7f2874180d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f285c009760 tx=0x7f285c009060).ready entity=mon.0 client_cookie=faf5523d940311d5 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f287159a700 1 -- 172.21.15.62:0/2671982300 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0090d0 con 0x7f2874175590 2022-09-17T10:28:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f287159a700 1 -- 172.21.15.62:0/2671982300 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c00b520 con 0x7f2874175590 2022-09-17T10:28:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.149+0000 7f287159a700 1 -- 172.21.15.62:0/2671982300 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c00b8a0 con 0x7f2874175590 2022-09-17T10:28:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.150+0000 7f2878d57700 1 -- 172.21.15.62:0/2671982300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2874175590 msgr2=0x7f2874180d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.150+0000 7f2878d57700 1 --2- 172.21.15.62:0/2671982300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2874175590 0x7f2874180d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f285c009760 tx=0x7f285c009060).stop 2022-09-17T10:28:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.150+0000 7f2878d57700 1 -- 172.21.15.62:0/2671982300 shutdown_connections 2022-09-17T10:28:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.150+0000 7f2878d57700 1 --2- 172.21.15.62:0/2671982300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2874175590 0x7f2874180d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.150+0000 7f2878d57700 1 -- 172.21.15.62:0/2671982300 >> 172.21.15.62:0/2671982300 conn(0x7f287406a170 msgr2=0x7f28740f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.150+0000 7f2878d57700 1 -- 172.21.15.62:0/2671982300 shutdown_connections 2022-09-17T10:28:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.150+0000 7f2878d57700 1 -- 172.21.15.62:0/2671982300 wait complete. 2022-09-17T10:28:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.151+0000 7f2878d57700 1 Processor -- start 2022-09-17T10:28:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.151+0000 7f2878d57700 1 -- start start 2022-09-17T10:28:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2878d57700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740ef650 0x7f2874176510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2878d57700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28741751b0 0x7f287418e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2878d57700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2874175590 0x7f287418ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2878d57700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287417df00 con 0x7f28741751b0 2022-09-17T10:28:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2878d57700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287418f390 con 0x7f2874175590 2022-09-17T10:28:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2878d57700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287418f670 con 0x7f28740ef650 2022-09-17T10:28:05.165 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2871d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28741751b0 0x7f287418e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2871d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28741751b0 0x7f287418e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49928/0 (socket says 172.21.15.62:49928) 2022-09-17T10:28:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.152+0000 7f2871d9b700 1 -- 172.21.15.62:0/862619875 learned_addr learned my addr 172.21.15.62:0/862619875 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f287259c700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740ef650 0x7f2874176510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.166 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f2871d9b700 1 -- 172.21.15.62:0/862619875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740ef650 msgr2=0x7f2874176510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f2871d9b700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740ef650 0x7f2874176510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f2871d9b700 1 -- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2874175590 msgr2=0x7f287418ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f2871d9b700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2874175590 0x7f287418ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f2871d9b700 1 -- 172.21.15.62:0/862619875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0092a0 con 0x7f28741751b0 2022-09-17T10:28:05.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f2871d9b700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28741751b0 0x7f287418e830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f285c009eb0 tx=0x7f285c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f286a7fc700 1 -- 172.21.15.62:0/862619875 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c011af0 con 0x7f28741751b0 2022-09-17T10:28:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f286a7fc700 1 -- 172.21.15.62:0/862619875 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c011c50 con 0x7f28741751b0 2022-09-17T10:28:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287417d5d0 con 0x7f28741751b0 2022-09-17T10:28:05.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f286a7fc700 1 -- 172.21.15.62:0/862619875 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c01b440 con 0x7f28741751b0 2022-09-17T10:28:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.153+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287417db90 con 0x7f28741751b0 2022-09-17T10:28:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.154+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287406bf40 con 0x7f28741751b0 2022-09-17T10:28:05.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.155+0000 7f286a7fc700 1 -- 172.21.15.62:0/862619875 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f285c00f070 con 0x7f28741751b0 2022-09-17T10:28:05.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.155+0000 7f286a7fc700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f285808ba40 0x7f285808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.155+0000 7f286a7fc700 1 -- 172.21.15.62:0/862619875 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f285c0b20d0 con 0x7f28741751b0 2022-09-17T10:28:05.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.155+0000 7f287259c700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f285808ba40 0x7f285808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.156+0000 7f287259c700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f285808ba40 0x7f285808df00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f286c001d60 tx=0x7f286c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.172 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.159+0000 7f286a7fc700 1 -- 172.21.15.62:0/862619875 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f285c082d90 con 0x7f28741751b0 2022-09-17T10:28:05.340 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.338+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f28740f0b20 con 0x7f28741751b0 2022-09-17T10:28:05.340 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.338+0000 7f286a7fc700 1 -- 172.21.15.62:0/862619875 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f285c0863b0 con 0x7f28741751b0 2022-09-17T10:28:05.340 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f285808ba40 msgr2=0x7f285808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f285808ba40 0x7f285808df00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f286c001d60 tx=0x7f286c009040).stop 2022-09-17T10:28:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28741751b0 msgr2=0x7f287418e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28741751b0 0x7f287418e830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f285c009eb0 tx=0x7f285c017000).stop 2022-09-17T10:28:05.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 shutdown_connections 2022-09-17T10:28:05.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f285808ba40 0x7f285808df00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2874175590 0x7f287418ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:05.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28740ef650 0x7f2874176510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 --2- 172.21.15.62:0/862619875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28741751b0 0x7f287418e830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.347 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 >> 172.21.15.62:0/862619875 conn(0x7f287406a170 msgr2=0x7f28740effe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:05.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 shutdown_connections 2022-09-17T10:28:05.348 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.340+0000 7f2878d57700 1 -- 172.21.15.62:0/862619875 wait complete. 2022-09-17T10:28:05.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.2 2022-09-17T10:28:05.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-09-17T10:28:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.470+0000 7ff486d56700 1 Processor -- start 2022-09-17T10:28:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.470+0000 7ff486d56700 1 -- start start 2022-09-17T10:28:05.475 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff486d56700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4801751b0 0x7ff480180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.476 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff486d56700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff480175590 0x7ff480180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.476 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff486d56700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4800c6dd0 con 0x7ff480181050 2022-09-17T10:28:05.476 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff486d56700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4800f10e0 con 0x7ff480175590 2022-09-17T10:28:05.476 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff486d56700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4800f0660 con 0x7ff4801751b0 2022-09-17T10:28:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff47ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff480175590 0x7ff480180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff4852f3700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff480181050 0x7ff480181dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57764/0 (socket says 172.21.15.62:57764) 2022-09-17T10:28:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff4852f3700 1 -- 172.21.15.62:0/2929830241 learned_addr learned my addr 172.21.15.62:0/2929830241 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff484af2700 1 --2- 172.21.15.62:0/2929830241 >> v2:172.21.15.93:3300/0 conn(0x7ff4801751b0 0x7ff480180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.478 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff47ffff700 1 -- 172.21.15.62:0/2929830241 >> v2:172.21.15.93:3300/0 conn(0x7ff4801751b0 msgr2=0x7ff480180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:05.478 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff47ffff700 1 --2- 172.21.15.62:0/2929830241 >> v2:172.21.15.93:3300/0 conn(0x7ff4801751b0 0x7ff480180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.478 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff47ffff700 1 -- 172.21.15.62:0/2929830241 >> v1:172.21.15.62:6789/0 conn(0x7ff480181050 legacy=0x7ff480181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.478 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff47f7fe700 1 -- 172.21.15.62:0/2929830241 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034875100 0 0) 0x7ff4800c6dd0 con 0x7ff480181050 2022-09-17T10:28:05.479 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.471+0000 7ff47ffff700 1 -- 172.21.15.62:0/2929830241 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4801801e0 con 0x7ff480175590 2022-09-17T10:28:05.479 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff47ffff700 1 --2- 172.21.15.62:0/2929830241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480175590 0x7ff480180b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7ff480088880 tx=0x7ff46c009060).ready entity=mon.0 client_cookie=976a0ab70827f6f server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.479 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff47f7fe700 1 -- 172.21.15.62:0/2929830241 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0090d0 con 0x7ff480175590 2022-09-17T10:28:05.479 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff47f7fe700 1 -- 172.21.15.62:0/2929830241 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00f510 con 0x7ff480175590 2022-09-17T10:28:05.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff47f7fe700 1 -- 172.21.15.62:0/2929830241 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00f890 con 0x7ff480175590 2022-09-17T10:28:05.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff486d56700 1 -- 172.21.15.62:0/2929830241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480175590 msgr2=0x7ff480180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff486d56700 1 --2- 172.21.15.62:0/2929830241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480175590 0x7ff480180b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7ff480088880 tx=0x7ff46c009060).stop 2022-09-17T10:28:05.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff486d56700 1 -- 172.21.15.62:0/2929830241 shutdown_connections 2022-09-17T10:28:05.480 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff486d56700 1 --2- 172.21.15.62:0/2929830241 >> v2:172.21.15.93:3300/0 conn(0x7ff4801751b0 0x7ff480180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff486d56700 1 --2- 172.21.15.62:0/2929830241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480175590 0x7ff480180b60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff486d56700 1 -- 172.21.15.62:0/2929830241 >> 172.21.15.62:0/2929830241 conn(0x7ff48006a170 msgr2=0x7ff4800f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:05.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff486d56700 1 -- 172.21.15.62:0/2929830241 shutdown_connections 2022-09-17T10:28:05.481 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.472+0000 7ff486d56700 1 -- 172.21.15.62:0/2929830241 wait complete. 2022-09-17T10:28:05.482 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.474+0000 7ff486d56700 1 Processor -- start 2022-09-17T10:28:05.482 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.474+0000 7ff486d56700 1 -- start start 2022-09-17T10:28:05.485 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff486d56700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4801751b0 0x7ff4801927b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.486 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff486d56700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff480175590 0x7ff48016da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.486 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff486d56700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480181050 0x7ff48016def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.486 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff486d56700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4801776a0 con 0x7ff480181050 2022-09-17T10:28:05.486 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff486d56700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff480177980 con 0x7ff480175590 2022-09-17T10:28:05.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff486d56700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff480177c60 con 0x7ff4801751b0 2022-09-17T10:28:05.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480181050 0x7ff48016def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480181050 0x7ff48016def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49950/0 (socket says 172.21.15.62:49950) 2022-09-17T10:28:05.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 -- 172.21.15.62:0/1442043068 learned_addr learned my addr 172.21.15.62:0/1442043068 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:05.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff484af2700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4801751b0 0x7ff4801927b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff47ffff700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff480175590 0x7ff48016da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 -- 172.21.15.62:0/1442043068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4801751b0 msgr2=0x7ff4801927b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4801751b0 0x7ff4801927b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 -- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff480175590 msgr2=0x7ff48016da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff480175590 0x7ff48016da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 -- 172.21.15.62:0/1442043068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0092a0 con 0x7ff480181050 2022-09-17T10:28:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff47ffff700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff480175590 0x7ff48016da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff4852f3700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480181050 0x7ff48016def0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ff47800c810 tx=0x7ff4780014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.475+0000 7ff47cff9700 1 -- 172.21.15.62:0/1442043068 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478005d30 con 0x7ff480181050 2022-09-17T10:28:05.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.476+0000 7ff47cff9700 1 -- 172.21.15.62:0/1442043068 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478005e90 con 0x7ff480181050 2022-09-17T10:28:05.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.476+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48017c070 con 0x7ff480181050 2022-09-17T10:28:05.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.476+0000 7ff47cff9700 1 -- 172.21.15.62:0/1442043068 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478007320 con 0x7ff480181050 2022-09-17T10:28:05.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.476+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48017c630 con 0x7ff480181050 2022-09-17T10:28:05.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.476+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48017c850 con 0x7ff480181050 2022-09-17T10:28:05.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.477+0000 7ff47cff9700 1 -- 172.21.15.62:0/1442043068 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7ff478010030 con 0x7ff480181050 2022-09-17T10:28:05.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.478+0000 7ff47cff9700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff46808ba40 0x7ff46808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.478+0000 7ff47cff9700 1 -- 172.21.15.62:0/1442043068 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff4780b0780 con 0x7ff480181050 2022-09-17T10:28:05.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.478+0000 7ff484af2700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff46808ba40 0x7ff46808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.479+0000 7ff484af2700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff46808ba40 0x7ff46808df00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff474009bc0 tx=0x7ff474008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.482+0000 7ff47cff9700 1 -- 172.21.15.62:0/1442043068 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7ff478081440 con 0x7ff480181050 2022-09-17T10:28:05.657 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.653+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff48006bf40 con 0x7ff480181050 2022-09-17T10:28:05.657 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.654+0000 7ff47cff9700 1 -- 172.21.15.62:0/1442043068 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff478084a60 con 0x7ff480181050 2022-09-17T10:28:05.658 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:05.659 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff46808ba40 msgr2=0x7ff46808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.659 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff46808ba40 0x7ff46808df00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff474009bc0 tx=0x7ff474008040).stop 2022-09-17T10:28:05.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480181050 msgr2=0x7ff48016def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480181050 0x7ff48016def0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ff47800c810 tx=0x7ff4780014d0).stop 2022-09-17T10:28:05.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 shutdown_connections 2022-09-17T10:28:05.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7ff46808ba40 0x7ff46808df00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff480181050 0x7ff48016def0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4801751b0 0x7ff4801927b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 --2- 172.21.15.62:0/1442043068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff480175590 0x7ff48016da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.655+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 >> 172.21.15.62:0/1442043068 conn(0x7ff48006a170 msgr2=0x7ff480063a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:05.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.656+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 shutdown_connections 2022-09-17T10:28:05.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.656+0000 7ff486d56700 1 -- 172.21.15.62:0/1442043068 wait complete. 2022-09-17T10:28:05.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444041 for osd.3 2022-09-17T10:28:05.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-09-17T10:28:05.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.786+0000 7f10d3b8e700 1 Processor -- start 2022-09-17T10:28:05.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.786+0000 7f10d3b8e700 1 -- start start 2022-09-17T10:28:05.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d3b8e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f10cc1785e0 0x7f10cc0ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d3b8e700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f10cc0efde0 0x7f10cc063350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d3b8e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f10cc063840 0x7f10cc063cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d3b8e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc062ec0 con 0x7f10cc1785e0 2022-09-17T10:28:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d3b8e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc17e1c0 con 0x7f10cc063840 2022-09-17T10:28:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d3b8e700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc062010 con 0x7f10cc0efde0 2022-09-17T10:28:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d192a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f10cc1785e0 0x7f10cc0ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d192a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f10cc1785e0 0x7f10cc0ef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49956/0 (socket says 172.21.15.62:49956) 2022-09-17T10:28:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d192a700 1 -- 172.21.15.62:0/3515463827 learned_addr learned my addr 172.21.15.62:0/3515463827 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.787+0000 7f10d212b700 1 --2- 172.21.15.62:0/3515463827 >> v2:172.21.15.93:3300/0 conn(0x7f10cc063840 0x7f10cc063cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d1129700 1 --2- 172.21.15.62:0/3515463827 >> v2:172.21.15.159:3300/0 conn(0x7f10cc0efde0 0x7f10cc063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d192a700 1 -- 172.21.15.62:0/3515463827 >> v2:172.21.15.159:3300/0 conn(0x7f10cc0efde0 msgr2=0x7f10cc063350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d192a700 1 --2- 172.21.15.62:0/3515463827 >> v2:172.21.15.159:3300/0 conn(0x7f10cc0efde0 0x7f10cc063350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d192a700 1 -- 172.21.15.62:0/3515463827 >> v2:172.21.15.93:3300/0 conn(0x7f10cc063840 msgr2=0x7f10cc063cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:05.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d192a700 1 --2- 172.21.15.62:0/3515463827 >> v2:172.21.15.93:3300/0 conn(0x7f10cc063840 0x7f10cc063cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d192a700 1 -- 172.21.15.62:0/3515463827 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0622b0 con 0x7f10cc1785e0 2022-09-17T10:28:05.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d192a700 1 --2- 172.21.15.62:0/3515463827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc1785e0 0x7f10cc0ef8f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f10cc17f410 tx=0x7f10bc0090f0).ready entity=mon.0 client_cookie=edc40f170e68e7ac server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d0928700 1 -- 172.21.15.62:0/3515463827 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00b520 con 0x7f10cc1785e0 2022-09-17T10:28:05.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d0928700 1 -- 172.21.15.62:0/3515463827 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc00b680 con 0x7f10cc1785e0 2022-09-17T10:28:05.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d0928700 1 -- 172.21.15.62:0/3515463827 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00ba00 con 0x7f10cc1785e0 2022-09-17T10:28:05.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d3b8e700 1 -- 172.21.15.62:0/3515463827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc1785e0 msgr2=0x7f10cc0ef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/3515463827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc1785e0 0x7f10cc0ef8f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f10cc17f410 tx=0x7f10bc0090f0).stop 2022-09-17T10:28:05.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d3b8e700 1 -- 172.21.15.62:0/3515463827 shutdown_connections 2022-09-17T10:28:05.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/3515463827 >> v2:172.21.15.93:3300/0 conn(0x7f10cc063840 0x7f10cc063cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/3515463827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc1785e0 0x7f10cc0ef8f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/3515463827 >> v2:172.21.15.159:3300/0 conn(0x7f10cc0efde0 0x7f10cc063350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.788+0000 7f10d3b8e700 1 -- 172.21.15.62:0/3515463827 >> 172.21.15.62:0/3515463827 conn(0x7f10cc06a170 msgr2=0x7f10cc0f4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:05.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.789+0000 7f10d3b8e700 1 -- 172.21.15.62:0/3515463827 shutdown_connections 2022-09-17T10:28:05.807 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.789+0000 7f10d3b8e700 1 -- 172.21.15.62:0/3515463827 wait complete. 2022-09-17T10:28:05.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.790+0000 7f10d3b8e700 1 Processor -- start 2022-09-17T10:28:05.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.790+0000 7f10d3b8e700 1 -- start start 2022-09-17T10:28:05.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d3b8e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc063840 0x7f10cc171ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d3b8e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10cc0efde0 0x7f10cc1684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.808 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d3b8e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10cc1785e0 0x7f10cc16f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d3b8e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc1723d0 con 0x7f10cc063840 2022-09-17T10:28:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d3b8e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc16e530 con 0x7f10cc1785e0 2022-09-17T10:28:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d3b8e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc16e7d0 con 0x7f10cc0efde0 2022-09-17T10:28:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d192a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc063840 0x7f10cc171ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d192a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc063840 0x7f10cc171ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49970/0 (socket says 172.21.15.62:49970) 2022-09-17T10:28:05.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d192a700 1 -- 172.21.15.62:0/711331876 learned_addr learned my addr 172.21.15.62:0/711331876 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:05.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d1129700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10cc0efde0 0x7f10cc1684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d212b700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10cc1785e0 0x7f10cc16f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d192a700 1 -- 172.21.15.62:0/711331876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10cc0efde0 msgr2=0x7f10cc1684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d192a700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10cc0efde0 0x7f10cc1684e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d192a700 1 -- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10cc1785e0 msgr2=0x7f10cc16f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d192a700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10cc1785e0 0x7f10cc16f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d192a700 1 -- 172.21.15.62:0/711331876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc009370 con 0x7f10cc063840 2022-09-17T10:28:05.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.791+0000 7f10d212b700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10cc1785e0 0x7f10cc16f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:05.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.792+0000 7f10d192a700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc063840 0x7f10cc171ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f10bc009130 tx=0x7f10bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.792+0000 7f10c9ffb700 1 -- 172.21.15.62:0/711331876 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00be90 con 0x7f10cc063840 2022-09-17T10:28:05.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.792+0000 7f10c9ffb700 1 -- 172.21.15.62:0/711331876 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc00b7f0 con 0x7f10cc063840 2022-09-17T10:28:05.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.792+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc16eab0 con 0x7f10cc063840 2022-09-17T10:28:05.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.792+0000 7f10c9ffb700 1 -- 172.21.15.62:0/711331876 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc01c670 con 0x7f10cc063840 2022-09-17T10:28:05.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.792+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc16f070 con 0x7f10cc063840 2022-09-17T10:28:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.793+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc16f260 con 0x7f10cc063840 2022-09-17T10:28:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.794+0000 7f10c9ffb700 1 -- 172.21.15.62:0/711331876 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f10bc02c070 con 0x7f10cc063840 2022-09-17T10:28:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.794+0000 7f10c9ffb700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f10ac08ba40 0x7f10ac08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.794+0000 7f10c9ffb700 1 -- 172.21.15.62:0/711331876 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f10bc0b23f0 con 0x7f10cc063840 2022-09-17T10:28:05.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.794+0000 7f10d1129700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f10ac08ba40 0x7f10ac08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:05.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.795+0000 7f10d1129700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f10ac08ba40 0x7f10ac08df00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f10c0006fd0 tx=0x7f10c0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.798+0000 7f10c9ffb700 1 -- 172.21.15.62:0/711331876 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f10bc0830b0 con 0x7f10cc063840 2022-09-17T10:28:05.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.971+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f10cc06bf40 con 0x7f10cc063840 2022-09-17T10:28:05.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.971+0000 7f10c9ffb700 1 -- 172.21.15.62:0/711331876 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10bc02a020 con 0x7f10cc063840 2022-09-17T10:28:05.974 INFO:teuthology.orchestra.run.smithi062.stdout:73014444042 2022-09-17T10:28:05.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f10ac08ba40 msgr2=0x7f10ac08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f10ac08ba40 0x7f10ac08df00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f10c0006fd0 tx=0x7f10c0008040).stop 2022-09-17T10:28:05.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc063840 msgr2=0x7f10cc171ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:05.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc063840 0x7f10cc171ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f10bc009130 tx=0x7f10bc017000).stop 2022-09-17T10:28:05.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 shutdown_connections 2022-09-17T10:28:05.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f10ac08ba40 0x7f10ac08df00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10cc1785e0 0x7f10cc16f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10cc063840 0x7f10cc171ee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 --2- 172.21.15.62:0/711331876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10cc0efde0 0x7f10cc1684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 >> 172.21.15.62:0/711331876 conn(0x7f10cc06a170 msgr2=0x7f10cc0c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 shutdown_connections 2022-09-17T10:28:05.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:05.973+0000 7f10d3b8e700 1 -- 172.21.15.62:0/711331876 wait complete. 2022-09-17T10:28:05.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444042 for osd.4 2022-09-17T10:28:05.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-09-17T10:28:06.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.103+0000 7f486b010700 1 Processor -- start 2022-09-17T10:28:06.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.103+0000 7f486b010700 1 -- start start 2022-09-17T10:28:06.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.104+0000 7f486b010700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4864175590 0x7f4864180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f486b010700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48640c6dd0 con 0x7f48641751b0 2022-09-17T10:28:06.124 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f486b010700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48641801e0 con 0x7f48640ef650 2022-09-17T10:28:06.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f486b010700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48640f10e0 con 0x7f4864175590 2022-09-17T10:28:06.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f4868dac700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f48641751b0 0x7f4864180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57768/0 (socket says 172.21.15.62:57768) 2022-09-17T10:28:06.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f4868dac700 1 -- 172.21.15.62:0/1391865553 learned_addr learned my addr 172.21.15.62:0/1391865553 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:06.125 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f4863fff700 1 --2- 172.21.15.62:0/1391865553 >> v2:172.21.15.93:3300/0 conn(0x7f4864175590 0x7f4864180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755915772 0 0) 0x7f48640c6dd0 con 0x7f48641751b0 2022-09-17T10:28:06.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48500033f0 con 0x7f48641751b0 2022-09-17T10:28:06.126 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441102296 0 0) 0x7f48641801e0 con 0x7f48640ef650 2022-09-17T10:28:06.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48640c6dd0 con 0x7f48640ef650 2022-09-17T10:28:06.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3664800188 0 0) 0x7f48500033f0 con 0x7f48641751b0 2022-09-17T10:28:06.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 >> v2:172.21.15.93:3300/0 conn(0x7f4864175590 msgr2=0x7f4864180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:06.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 --2- 172.21.15.62:0/1391865553 >> v2:172.21.15.93:3300/0 conn(0x7f4864175590 0x7f4864180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 >> v1:172.21.15.159:6789/0 conn(0x7f48640ef650 legacy=0x7f48640efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640f0840 con 0x7f48641751b0 2022-09-17T10:28:06.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f485c0017f0 con 0x7f48641751b0 2022-09-17T10:28:06.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 >> v1:172.21.15.62:6789/0 conn(0x7f48641751b0 legacy=0x7f4864180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850003ac0 0x7f4850003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4850004690 0x7f4850004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4850005070 0x7f485000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48640f10e0 con 0x7f4850005070 2022-09-17T10:28:06.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485000c010 con 0x7f4850003ac0 2022-09-17T10:28:06.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485000c1d0 con 0x7f4850004690 2022-09-17T10:28:06.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.105+0000 7f48695ad700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4850005070 0x7f485000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f4863fff700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4850004690 0x7f4850004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f4868dac700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850003ac0 0x7f4850003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48695ad700 1 -- 172.21.15.62:0/1391865553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4850004690 msgr2=0x7f4850004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:06.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48695ad700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4850004690 0x7f4850004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48695ad700 1 -- 172.21.15.62:0/1391865553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850003ac0 msgr2=0x7f4850003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:06.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48695ad700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850003ac0 0x7f4850003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48695ad700 1 -- 172.21.15.62:0/1391865553 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500033f0 con 0x7f4850005070 2022-09-17T10:28:06.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48695ad700 1 -- 172.21.15.62:0/1391865553 reap_dead start 2022-09-17T10:28:06.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48695ad700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4850005070 0x7f485000b8e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f4854001890 tx=0x7f4854007bb0).ready entity=mon.0 client_cookie=8fc3454ffaec5822 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854007020 con 0x7f4850005070 2022-09-17T10:28:06.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854007180 con 0x7f4850005070 2022-09-17T10:28:06.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f48637fe700 1 -- 172.21.15.62:0/1391865553 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854007500 con 0x7f4850005070 2022-09-17T10:28:06.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f486b010700 1 -- 172.21.15.62:0/1391865553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4850005070 msgr2=0x7f485000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.106+0000 7f486b010700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4850005070 0x7f485000b8e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f4854001890 tx=0x7f4854007bb0).stop 2022-09-17T10:28:06.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.107+0000 7f486b010700 1 -- 172.21.15.62:0/1391865553 shutdown_connections 2022-09-17T10:28:06.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.107+0000 7f486b010700 1 --2- 172.21.15.62:0/1391865553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4850005070 0x7f485000b8e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.107+0000 7f486b010700 1 -- 172.21.15.62:0/1391865553 >> 172.21.15.62:0/1391865553 conn(0x7f486406a170 msgr2=0x7f48640f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:06.140 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.107+0000 7f486b010700 1 -- 172.21.15.62:0/1391865553 shutdown_connections 2022-09-17T10:28:06.140 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.107+0000 7f486b010700 1 -- 172.21.15.62:0/1391865553 wait complete. 2022-09-17T10:28:06.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.108+0000 7f486b010700 1 Processor -- start 2022-09-17T10:28:06.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.108+0000 7f486b010700 1 -- start start 2022-09-17T10:28:06.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f486b010700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850005070 0x7f486416de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f486b010700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864063920 0x7f4864063da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f486b010700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f486418ee60 0x7f486418f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f486b010700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486417a4c0 con 0x7f4864063920 2022-09-17T10:28:06.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f486b010700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864064290 con 0x7f4850005070 2022-09-17T10:28:06.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f486b010700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864062950 con 0x7f486418ee60 2022-09-17T10:28:06.144 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f4863fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864063920 0x7f4864063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f4863fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864063920 0x7f4864063da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49998/0 (socket says 172.21.15.62:49998) 2022-09-17T10:28:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f4863fff700 1 -- 172.21.15.62:0/3873768248 learned_addr learned my addr 172.21.15.62:0/3873768248 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:06.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f4868dac700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850005070 0x7f486416de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.146 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f48695ad700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f486418ee60 0x7f486418f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.109+0000 7f4863fff700 1 -- 172.21.15.62:0/3873768248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f486418ee60 msgr2=0x7f486418f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f4863fff700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f486418ee60 0x7f486418f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f4863fff700 1 -- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850005070 msgr2=0x7f486416de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f4863fff700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850005070 0x7f486416de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f4863fff700 1 -- 172.21.15.62:0/3873768248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864063490 con 0x7f4864063920 2022-09-17T10:28:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f4863fff700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864063920 0x7f4864063da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f48580119c0 tx=0x7f4858009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f4860ff9700 1 -- 172.21.15.62:0/3873768248 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800f940 con 0x7f4864063920 2022-09-17T10:28:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f4860ff9700 1 -- 172.21.15.62:0/3873768248 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485800faa0 con 0x7f4864063920 2022-09-17T10:28:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486418f7d0 con 0x7f4864063920 2022-09-17T10:28:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f4860ff9700 1 -- 172.21.15.62:0/3873768248 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800fe60 con 0x7f4864063920 2022-09-17T10:28:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.110+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4864062b60 con 0x7f4864063920 2022-09-17T10:28:06.152 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.111+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486406bf40 con 0x7f4864063920 2022-09-17T10:28:06.152 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.112+0000 7f4860ff9700 1 -- 172.21.15.62:0/3873768248 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4858024070 con 0x7f4864063920 2022-09-17T10:28:06.153 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.112+0000 7f4860ff9700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f484408ba40 0x7f484408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.153 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.112+0000 7f4860ff9700 1 -- 172.21.15.62:0/3873768248 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f48580b1990 con 0x7f4864063920 2022-09-17T10:28:06.154 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.113+0000 7f4868dac700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f484408ba40 0x7f484408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.154 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.113+0000 7f4868dac700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f484408ba40 0x7f484408df00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f485c007db0 tx=0x7f485c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.155 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.115+0000 7f4860ff9700 1 -- 172.21.15.62:0/3873768248 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f48580825d0 con 0x7f4864063920 2022-09-17T10:28:06.290 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.288+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f48640f0b20 con 0x7f4864063920 2022-09-17T10:28:06.291 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.289+0000 7f4860ff9700 1 -- 172.21.15.62:0/3873768248 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4858085bf0 con 0x7f4864063920 2022-09-17T10:28:06.291 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:06.293 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f484408ba40 msgr2=0x7f484408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.293 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f484408ba40 0x7f484408df00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f485c007db0 tx=0x7f485c009040).stop 2022-09-17T10:28:06.293 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864063920 msgr2=0x7f4864063da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.294 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864063920 0x7f4864063da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f48580119c0 tx=0x7f4858009060).stop 2022-09-17T10:28:06.294 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 shutdown_connections 2022-09-17T10:28:06.294 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f484408ba40 0x7f484408df00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.294 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4850005070 0x7f486416de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.295 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f486418ee60 0x7f486418f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.295 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 --2- 172.21.15.62:0/3873768248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4864063920 0x7f4864063da0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.295 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.290+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 >> 172.21.15.62:0/3873768248 conn(0x7f486406a170 msgr2=0x7f486416e930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:06.295 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.291+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 shutdown_connections 2022-09-17T10:28:06.296 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.291+0000 7f486b010700 1 -- 172.21.15.62:0/3873768248 wait complete. 2022-09-17T10:28:06.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.5 2022-09-17T10:28:06.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-09-17T10:28:06.423 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.421+0000 7f9332eef700 1 Processor -- start 2022-09-17T10:28:06.423 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.421+0000 7f9332eef700 1 -- start start 2022-09-17T10:28:06.430 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9332eef700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f932c17dcd0 0x7f932c17e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.431 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9332eef700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f932c17ebf0 0x7f932c17f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.431 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9332eef700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f932c0e5530 0x7f932c0e59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.432 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9332eef700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c17f560 con 0x7f932c17dcd0 2022-09-17T10:28:06.432 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9332eef700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c0eb860 con 0x7f932c17ebf0 2022-09-17T10:28:06.432 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9332eef700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c0e50a0 con 0x7f932c0e5530 2022-09-17T10:28:06.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f932c17dcd0 0x7f932c17e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f932c17dcd0 0x7f932c17e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50008/0 (socket says 172.21.15.62:50008) 2022-09-17T10:28:06.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 -- 172.21.15.62:0/3203177610 learned_addr learned my addr 172.21.15.62:0/3203177610 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:06.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f93326ee700 1 --2- 172.21.15.62:0/3203177610 >> v2:172.21.15.159:3300/0 conn(0x7f932c0e5530 0x7f932c0e59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f93316ec700 1 --2- 172.21.15.62:0/3203177610 >> v2:172.21.15.93:3300/0 conn(0x7f932c17ebf0 0x7f932c17f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 -- 172.21.15.62:0/3203177610 >> v2:172.21.15.159:3300/0 conn(0x7f932c0e5530 msgr2=0x7f932c0e59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 --2- 172.21.15.62:0/3203177610 >> v2:172.21.15.159:3300/0 conn(0x7f932c0e5530 0x7f932c0e59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 -- 172.21.15.62:0/3203177610 >> v2:172.21.15.93:3300/0 conn(0x7f932c17ebf0 msgr2=0x7f932c17f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:06.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 --2- 172.21.15.62:0/3203177610 >> v2:172.21.15.93:3300/0 conn(0x7f932c17ebf0 0x7f932c17f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 -- 172.21.15.62:0/3203177610 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0e47b0 con 0x7f932c17dcd0 2022-09-17T10:28:06.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9331eed700 1 --2- 172.21.15.62:0/3203177610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c17dcd0 0x7f932c17e0b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f932c0ef590 tx=0x7f93280090f0).ready entity=mon.0 client_cookie=8d3938309a4d6bec server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.436 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9330eeb700 1 -- 172.21.15.62:0/3203177610 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932800f510 con 0x7f932c17dcd0 2022-09-17T10:28:06.436 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.423+0000 7f9330eeb700 1 -- 172.21.15.62:0/3203177610 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932800f670 con 0x7f932c17dcd0 2022-09-17T10:28:06.436 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9330eeb700 1 -- 172.21.15.62:0/3203177610 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932800fa10 con 0x7f932c17dcd0 2022-09-17T10:28:06.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 -- 172.21.15.62:0/3203177610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c17dcd0 msgr2=0x7f932c17e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 --2- 172.21.15.62:0/3203177610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c17dcd0 0x7f932c17e0b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f932c0ef590 tx=0x7f93280090f0).stop 2022-09-17T10:28:06.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 -- 172.21.15.62:0/3203177610 shutdown_connections 2022-09-17T10:28:06.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 --2- 172.21.15.62:0/3203177610 >> v2:172.21.15.159:3300/0 conn(0x7f932c0e5530 0x7f932c0e59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 --2- 172.21.15.62:0/3203177610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c17dcd0 0x7f932c17e0b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 --2- 172.21.15.62:0/3203177610 >> v2:172.21.15.93:3300/0 conn(0x7f932c17ebf0 0x7f932c17f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 -- 172.21.15.62:0/3203177610 >> 172.21.15.62:0/3203177610 conn(0x7f932c0de5f0 msgr2=0x7f932c05d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:06.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 -- 172.21.15.62:0/3203177610 shutdown_connections 2022-09-17T10:28:06.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.424+0000 7f9332eef700 1 -- 172.21.15.62:0/3203177610 wait complete. 2022-09-17T10:28:06.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.426+0000 7f9332eef700 1 Processor -- start 2022-09-17T10:28:06.440 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.426+0000 7f9332eef700 1 -- start start 2022-09-17T10:28:06.440 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9332eef700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c0e5530 0x7f932c170660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.440 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9332eef700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f932c17dcd0 0x7f932c170b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.441 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9332eef700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f932c17ebf0 0x7f932c0e59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.441 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9332eef700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c0eced0 con 0x7f932c0e5530 2022-09-17T10:28:06.441 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9332eef700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c0e72d0 con 0x7f932c17dcd0 2022-09-17T10:28:06.441 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9332eef700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c0e6750 con 0x7f932c17ebf0 2022-09-17T10:28:06.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c0e5530 0x7f932c170660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c0e5530 0x7f932c170660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50018/0 (socket says 172.21.15.62:50018) 2022-09-17T10:28:06.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 -- 172.21.15.62:0/2210931483 learned_addr learned my addr 172.21.15.62:0/2210931483 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:06.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f93326ee700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f932c17ebf0 0x7f932c0e59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f93316ec700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f932c17dcd0 0x7f932c170b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 -- 172.21.15.62:0/2210931483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f932c17ebf0 msgr2=0x7f932c0e59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f932c17ebf0 0x7f932c0e59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 -- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f932c17dcd0 msgr2=0x7f932c170b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f932c17dcd0 0x7f932c170b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 -- 172.21.15.62:0/2210931483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328009370 con 0x7f932c0e5530 2022-09-17T10:28:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9331eed700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c0e5530 0x7f932c170660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f9328006fd0 tx=0x7f9328017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9319ffb700 1 -- 172.21.15.62:0/2210931483 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328006970 con 0x7f932c0e5530 2022-09-17T10:28:06.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9319ffb700 1 -- 172.21.15.62:0/2210931483 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9328000bc0 con 0x7f932c0e5530 2022-09-17T10:28:06.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c0e6a30 con 0x7f932c0e5530 2022-09-17T10:28:06.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.427+0000 7f9319ffb700 1 -- 172.21.15.62:0/2210931483 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328024470 con 0x7f932c0e5530 2022-09-17T10:28:06.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.428+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c0e6ff0 con 0x7f932c0e5530 2022-09-17T10:28:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.429+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c06bf00 con 0x7f932c0e5530 2022-09-17T10:28:06.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.429+0000 7f9319ffb700 1 -- 172.21.15.62:0/2210931483 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f932800f070 con 0x7f932c0e5530 2022-09-17T10:28:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.430+0000 7f9319ffb700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f930c08ba40 0x7f930c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.430+0000 7f9319ffb700 1 -- 172.21.15.62:0/2210931483 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f93280b2330 con 0x7f932c0e5530 2022-09-17T10:28:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.431+0000 7f93316ec700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f930c08ba40 0x7f930c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.431+0000 7f93316ec700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f930c08ba40 0x7f930c08df00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f932c0eeea0 tx=0x7f931c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.434+0000 7f9319ffb700 1 -- 172.21.15.62:0/2210931483 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f9328082ff0 con 0x7f932c0e5530 2022-09-17T10:28:06.608 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.606+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f932c0eb580 con 0x7f932c0e5530 2022-09-17T10:28:06.609 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.606+0000 7f9319ffb700 1 -- 172.21.15.62:0/2210931483 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9328086610 con 0x7f932c0e5530 2022-09-17T10:28:06.609 INFO:teuthology.orchestra.run.smithi062.stdout:73014444040 2022-09-17T10:28:06.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f930c08ba40 msgr2=0x7f930c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.612 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f930c08ba40 0x7f930c08df00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f932c0eeea0 tx=0x7f931c008040).stop 2022-09-17T10:28:06.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c0e5530 msgr2=0x7f932c170660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.613 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c0e5530 0x7f932c170660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f9328006fd0 tx=0x7f9328017000).stop 2022-09-17T10:28:06.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 shutdown_connections 2022-09-17T10:28:06.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f930c08ba40 0x7f930c08df00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.614 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f932c17ebf0 0x7f932c0e59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f932c0e5530 0x7f932c170660 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.615 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 --2- 172.21.15.62:0/2210931483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f932c17dcd0 0x7f932c170b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.616 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 >> 172.21.15.62:0/2210931483 conn(0x7f932c0de5f0 msgr2=0x7f932c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:06.616 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 shutdown_connections 2022-09-17T10:28:06.617 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.608+0000 7f9332eef700 1 -- 172.21.15.62:0/2210931483 wait complete. 2022-09-17T10:28:06.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.6 2022-09-17T10:28:06.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-09-17T10:28:06.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.738+0000 7fd9ae177700 1 Processor -- start 2022-09-17T10:28:06.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.738+0000 7fd9ae177700 1 -- start start 2022-09-17T10:28:06.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.739+0000 7fd9ae177700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd9a817e480 0x7fd9a817e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.739+0000 7fd9ae177700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a80e60b0 con 0x7fd9a817e0a0 2022-09-17T10:28:06.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.739+0000 7fd9ae177700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a80e5270 con 0x7fd9a8180060 2022-09-17T10:28:06.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.739+0000 7fd9ae177700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a80e2820 con 0x7fd9a817e480 2022-09-17T10:28:06.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9ac974700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fd9a8180060 0x7fd9a81804e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.62:40978/0 (socket says 172.21.15.62:40978) 2022-09-17T10:28:06.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9ac974700 1 -- 172.21.15.62:0/3151959779 learned_addr learned my addr 172.21.15.62:0/3151959779 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:06.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9ad976700 1 --2- 172.21.15.62:0/3151959779 >> v2:172.21.15.93:3300/0 conn(0x7fd9a817e480 0x7fd9a817e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9a7fff700 1 -- 172.21.15.62:0/3151959779 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704489880 0 0) 0x7fd9a80e5270 con 0x7fd9a8180060 2022-09-17T10:28:06.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9a7fff700 1 -- 172.21.15.62:0/3151959779 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9940033f0 con 0x7fd9a8180060 2022-09-17T10:28:06.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9ad976700 1 -- 172.21.15.62:0/3151959779 >> v1:172.21.15.159:6789/0 conn(0x7fd9a8180060 legacy=0x7fd9a81804e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9ad976700 1 -- 172.21.15.62:0/3151959779 >> v1:172.21.15.93:6789/0 conn(0x7fd9a817e0a0 legacy=0x7fd9a80e4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9ad976700 1 -- 172.21.15.62:0/3151959779 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80e5530 con 0x7fd9a817e480 2022-09-17T10:28:06.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9ad976700 1 --2- 172.21.15.62:0/3151959779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a817e480 0x7fd9a817e910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd998009e60 tx=0x7fd998009780).ready entity=mon.1 client_cookie=84953083aaf5a40d server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9a7fff700 1 -- 172.21.15.62:0/3151959779 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99800e070 con 0x7fd9a817e480 2022-09-17T10:28:06.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9a7fff700 1 -- 172.21.15.62:0/3151959779 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99800bb60 con 0x7fd9a817e480 2022-09-17T10:28:06.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.740+0000 7fd9a7fff700 1 -- 172.21.15.62:0/3151959779 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998012410 con 0x7fd9a817e480 2022-09-17T10:28:06.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.741+0000 7fd9ae177700 1 -- 172.21.15.62:0/3151959779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a817e480 msgr2=0x7fd9a817e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.741+0000 7fd9ae177700 1 --2- 172.21.15.62:0/3151959779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a817e480 0x7fd9a817e910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd998009e60 tx=0x7fd998009780).stop 2022-09-17T10:28:06.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.741+0000 7fd9ae177700 1 -- 172.21.15.62:0/3151959779 shutdown_connections 2022-09-17T10:28:06.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.741+0000 7fd9ae177700 1 --2- 172.21.15.62:0/3151959779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a817e480 0x7fd9a817e910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.741+0000 7fd9ae177700 1 -- 172.21.15.62:0/3151959779 >> 172.21.15.62:0/3151959779 conn(0x7fd9a80ef950 msgr2=0x7fd9a80e1950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:06.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.741+0000 7fd9ae177700 1 -- 172.21.15.62:0/3151959779 shutdown_connections 2022-09-17T10:28:06.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.741+0000 7fd9ae177700 1 -- 172.21.15.62:0/3151959779 wait complete. 2022-09-17T10:28:06.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.742+0000 7fd9ae177700 1 Processor -- start 2022-09-17T10:28:06.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.742+0000 7fd9ae177700 1 -- start start 2022-09-17T10:28:06.754 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ae177700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a817e0a0 0x7fd9a80e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ae177700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a817e480 0x7fd9a80e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ae177700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a8180060 0x7fd9a8172b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ae177700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80e8590 con 0x7fd9a817e0a0 2022-09-17T10:28:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ae177700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80e76a0 con 0x7fd9a8180060 2022-09-17T10:28:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ae177700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80e7980 con 0x7fd9a817e480 2022-09-17T10:28:06.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a817e0a0 0x7fd9a80e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a817e0a0 0x7fd9a80e70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50024/0 (socket says 172.21.15.62:50024) 2022-09-17T10:28:06.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 -- 172.21.15.62:0/49394051 learned_addr learned my addr 172.21.15.62:0/49394051 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:06.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ac974700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a817e480 0x7fd9a80e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad976700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a8180060 0x7fd9a8172b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 -- 172.21.15.62:0/49394051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a817e480 msgr2=0x7fd9a80e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a817e480 0x7fd9a80e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 -- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a8180060 msgr2=0x7fd9a8172b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a8180060 0x7fd9a8172b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 -- 172.21.15.62:0/49394051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009a20 con 0x7fd9a817e0a0 2022-09-17T10:28:06.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ad175700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a817e0a0 0x7fd9a80e70e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fd9a000c440 tx=0x7fd9a0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9a57fa700 1 -- 172.21.15.62:0/49394051 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00123f0 con 0x7fd9a817e0a0 2022-09-17T10:28:06.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9a57fa700 1 -- 172.21.15.62:0/49394051 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a0001e90 con 0x7fd9a817e0a0 2022-09-17T10:28:06.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a80e7c60 con 0x7fd9a817e0a0 2022-09-17T10:28:06.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9a57fa700 1 -- 172.21.15.62:0/49394051 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0012780 con 0x7fd9a817e0a0 2022-09-17T10:28:06.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.744+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a80e8220 con 0x7fd9a817e0a0 2022-09-17T10:28:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.745+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a806bf00 con 0x7fd9a817e0a0 2022-09-17T10:28:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.746+0000 7fd9a57fa700 1 -- 172.21.15.62:0/49394051 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fd9a0010070 con 0x7fd9a817e0a0 2022-09-17T10:28:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.747+0000 7fd9a57fa700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd98808ba40 0x7fd98808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.747+0000 7fd9a57fa700 1 -- 172.21.15.62:0/49394051 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fd9a00afa30 con 0x7fd9a817e0a0 2022-09-17T10:28:06.760 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.747+0000 7fd9ac974700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd98808ba40 0x7fd98808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:06.761 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.747+0000 7fd9ac974700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd98808ba40 0x7fd98808df00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fd9a80eb830 tx=0x7fd99c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:06.761 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.750+0000 7fd9a57fa700 1 -- 172.21.15.62:0/49394051 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fd9a00806f0 con 0x7fd9a817e0a0 2022-09-17T10:28:06.926 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.924+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd9a80cb220 con 0x7fd9a817e0a0 2022-09-17T10:28:06.926 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.924+0000 7fd9a57fa700 1 -- 172.21.15.62:0/49394051 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9a0083d10 con 0x7fd9a817e0a0 2022-09-17T10:28:06.927 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd98808ba40 msgr2=0x7fd98808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd98808ba40 0x7fd98808df00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fd9a80eb830 tx=0x7fd99c009040).stop 2022-09-17T10:28:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a817e0a0 msgr2=0x7fd9a80e70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a817e0a0 0x7fd9a80e70e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fd9a000c440 tx=0x7fd9a0007db0).stop 2022-09-17T10:28:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 shutdown_connections 2022-09-17T10:28:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fd98808ba40 0x7fd98808df00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9a8180060 0x7fd9a8172b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a817e0a0 0x7fd9a80e70e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 --2- 172.21.15.62:0/49394051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a817e480 0x7fd9a80e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 >> 172.21.15.62:0/49394051 conn(0x7fd9a80ef950 msgr2=0x7fd9a80e66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 shutdown_connections 2022-09-17T10:28:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:06.926+0000 7fd9ae177700 1 -- 172.21.15.62:0/49394051 wait complete. 2022-09-17T10:28:06.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.7 2022-09-17T10:28:06.941 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2022-09-17T10:28:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.057+0000 7fcec3910700 1 Processor -- start 2022-09-17T10:28:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.057+0000 7fcec3910700 1 -- start start 2022-09-17T10:28:07.061 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.058+0000 7fcec3910700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcebc1751b0 0x7fcebc180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.061 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.058+0000 7fcec3910700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0c6dd0 con 0x7fcebc0ef650 2022-09-17T10:28:07.061 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.058+0000 7fcec3910700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc1801e0 con 0x7fcebc175590 2022-09-17T10:28:07.062 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.058+0000 7fcec3910700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc0f10e0 con 0x7fcebc1751b0 2022-09-17T10:28:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.058+0000 7fcec1ead700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcebc0ef650 0x7fcebc0efa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57778/0 (socket says 172.21.15.62:57778) 2022-09-17T10:28:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.058+0000 7fcec1ead700 1 -- 172.21.15.62:0/19838835 learned_addr learned my addr 172.21.15.62:0/19838835 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.058+0000 7fcec16ac700 1 --2- 172.21.15.62:0/19838835 >> v2:172.21.15.159:3300/0 conn(0x7fcebc1751b0 0x7fcebc180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.059+0000 7fcec16ac700 1 -- 172.21.15.62:0/19838835 >> v1:172.21.15.93:6789/0 conn(0x7fcebc175590 legacy=0x7fcebc180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.064 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.059+0000 7fcec16ac700 1 -- 172.21.15.62:0/19838835 >> v1:172.21.15.62:6789/0 conn(0x7fcebc0ef650 legacy=0x7fcebc0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.064 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.059+0000 7fcec16ac700 1 -- 172.21.15.62:0/19838835 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0f0840 con 0x7fcebc1751b0 2022-09-17T10:28:07.064 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.059+0000 7fcec16ac700 1 --2- 172.21.15.62:0/19838835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc1751b0 0x7fcebc180670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fceac009e60 tx=0x7fceac009780).ready entity=mon.2 client_cookie=e851d9bd0a186812 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.075 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcebbfff700 1 -- 172.21.15.62:0/19838835 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00e070 con 0x7fcebc1751b0 2022-09-17T10:28:07.076 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcebbfff700 1 -- 172.21.15.62:0/19838835 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00bc30 con 0x7fcebc1751b0 2022-09-17T10:28:07.076 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcebbfff700 1 -- 172.21.15.62:0/19838835 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac012410 con 0x7fcebc1751b0 2022-09-17T10:28:07.077 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcec3910700 1 -- 172.21.15.62:0/19838835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc1751b0 msgr2=0x7fcebc180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.077 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcec3910700 1 --2- 172.21.15.62:0/19838835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc1751b0 0x7fcebc180670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fceac009e60 tx=0x7fceac009780).stop 2022-09-17T10:28:07.077 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcec3910700 1 -- 172.21.15.62:0/19838835 shutdown_connections 2022-09-17T10:28:07.078 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcec3910700 1 --2- 172.21.15.62:0/19838835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc1751b0 0x7fcebc180670 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.078 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcec3910700 1 -- 172.21.15.62:0/19838835 >> 172.21.15.62:0/19838835 conn(0x7fcebc06a170 msgr2=0x7fcebc0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:07.079 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcec3910700 1 -- 172.21.15.62:0/19838835 shutdown_connections 2022-09-17T10:28:07.079 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.061+0000 7fcec3910700 1 -- 172.21.15.62:0/19838835 wait complete. 2022-09-17T10:28:07.080 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.063+0000 7fcec3910700 1 Processor -- start 2022-09-17T10:28:07.080 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.063+0000 7fcec3910700 1 -- start start 2022-09-17T10:28:07.081 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec3910700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcebc0ef650 0x7fcebc192c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.081 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec3910700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcebc1751b0 0x7fcebc16dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.081 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec3910700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc175590 0x7fcebc086370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.082 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec3910700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc191ec0 con 0x7fcebc1751b0 2022-09-17T10:28:07.082 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec3910700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc190fd0 con 0x7fcebc0ef650 2022-09-17T10:28:07.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec3910700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1912b0 con 0x7fcebc175590 2022-09-17T10:28:07.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcebc1751b0 0x7fcebc16dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcebc1751b0 0x7fcebc16dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50030/0 (socket says 172.21.15.62:50030) 2022-09-17T10:28:07.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 -- 172.21.15.62:0/2455635599 learned_addr learned my addr 172.21.15.62:0/2455635599 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:07.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec1ead700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc175590 0x7fcebc086370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec16ac700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcebc0ef650 0x7fcebc192c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 -- 172.21.15.62:0/2455635599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc175590 msgr2=0x7fcebc086370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc175590 0x7fcebc086370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 -- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcebc0ef650 msgr2=0x7fcebc192c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcebc0ef650 0x7fcebc192c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 -- 172.21.15.62:0/2455635599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac009a20 con 0x7fcebc1751b0 2022-09-17T10:28:07.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec1ead700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc175590 0x7fcebc086370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:07.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec16ac700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcebc0ef650 0x7fcebc192c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:07.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.064+0000 7fcec0eab700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcebc1751b0 0x7fcebc16dee0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fceb000c440 tx=0x7fceb0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.065+0000 7fceb97fa700 1 -- 172.21.15.62:0/2455635599 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000cea0 con 0x7fcebc1751b0 2022-09-17T10:28:07.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.065+0000 7fceb97fa700 1 -- 172.21.15.62:0/2455635599 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000f470 con 0x7fcebc1751b0 2022-09-17T10:28:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.065+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc191590 con 0x7fcebc1751b0 2022-09-17T10:28:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.065+0000 7fceb97fa700 1 -- 172.21.15.62:0/2455635599 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000f810 con 0x7fcebc1751b0 2022-09-17T10:28:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.065+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc191b50 con 0x7fcebc1751b0 2022-09-17T10:28:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.066+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc086090 con 0x7fcebc1751b0 2022-09-17T10:28:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.066+0000 7fceb97fa700 1 -- 172.21.15.62:0/2455635599 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fceb0019030 con 0x7fcebc1751b0 2022-09-17T10:28:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.067+0000 7fceb97fa700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fce9c08ba40 0x7fce9c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.067+0000 7fceb97fa700 1 -- 172.21.15.62:0/2455635599 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fceb00afbb0 con 0x7fcebc1751b0 2022-09-17T10:28:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.067+0000 7fcec16ac700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fce9c08ba40 0x7fce9c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.068+0000 7fcec16ac700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fce9c08ba40 0x7fce9c08df00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fceac0094d0 tx=0x7fceac009780).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.071+0000 7fceb97fa700 1 -- 172.21.15.62:0/2455635599 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fceb0080870 con 0x7fcebc1751b0 2022-09-17T10:28:07.247 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.245+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fcebc06bf40 con 0x7fcebc1751b0 2022-09-17T10:28:07.248 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.245+0000 7fceb97fa700 1 -- 172.21.15.62:0/2455635599 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fceb0017020 con 0x7fcebc1751b0 2022-09-17T10:28:07.248 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:07.250 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fce9c08ba40 msgr2=0x7fce9c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.250 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fce9c08ba40 0x7fce9c08df00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fceac0094d0 tx=0x7fceac009780).stop 2022-09-17T10:28:07.250 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcebc1751b0 msgr2=0x7fcebc16dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.251 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcebc1751b0 0x7fcebc16dee0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fceb000c440 tx=0x7fceb0007db0).stop 2022-09-17T10:28:07.251 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 shutdown_connections 2022-09-17T10:28:07.251 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fce9c08ba40 0x7fce9c08df00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.251 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcebc0ef650 0x7fcebc192c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.252 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcebc175590 0x7fcebc086370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.252 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 --2- 172.21.15.62:0/2455635599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcebc1751b0 0x7fcebc16dee0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.252 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 >> 172.21.15.62:0/2455635599 conn(0x7fcebc06a170 msgr2=0x7fcebc0efbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:07.252 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 shutdown_connections 2022-09-17T10:28:07.253 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.247+0000 7fcec3910700 1 -- 172.21.15.62:0/2455635599 wait complete. 2022-09-17T10:28:07.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.8 2022-09-17T10:28:07.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2022-09-17T10:28:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.378+0000 7fed31c35700 1 Processor -- start 2022-09-17T10:28:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.378+0000 7fed31c35700 1 -- start start 2022-09-17T10:28:07.392 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.379+0000 7fed31c35700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fed2c175590 0x7fed2c180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.393 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.379+0000 7fed31c35700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fed2c0ef650 0x7fed2c0efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.393 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.379+0000 7fed31c35700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c0c6dd0 con 0x7fed2c1751b0 2022-09-17T10:28:07.393 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.379+0000 7fed31c35700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c0f10e0 con 0x7fed2c175590 2022-09-17T10:28:07.393 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.379+0000 7fed31c35700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c1801e0 con 0x7fed2c0ef650 2022-09-17T10:28:07.394 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fed2c1751b0 0x7fed2c180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57786/0 (socket says 172.21.15.62:57786) 2022-09-17T10:28:07.394 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2b7fe700 1 -- 172.21.15.62:0/765663485 learned_addr learned my addr 172.21.15.62:0/765663485 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:07.394 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2bfff700 1 --2- 172.21.15.62:0/765663485 >> v2:172.21.15.159:3300/0 conn(0x7fed2c0ef650 0x7fed2c0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.394 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2affd700 1 --2- 172.21.15.62:0/765663485 >> v2:172.21.15.93:3300/0 conn(0x7fed2c175590 0x7fed2c180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.395 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341662425 0 0) 0x7fed2c0c6dd0 con 0x7fed2c1751b0 2022-09-17T10:28:07.395 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed180033f0 con 0x7fed2c1751b0 2022-09-17T10:28:07.395 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325022987 0 0) 0x7fed180033f0 con 0x7fed2c1751b0 2022-09-17T10:28:07.396 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 >> v2:172.21.15.159:3300/0 conn(0x7fed2c0ef650 msgr2=0x7fed2c0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:07.396 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 --2- 172.21.15.62:0/765663485 >> v2:172.21.15.159:3300/0 conn(0x7fed2c0ef650 0x7fed2c0efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.396 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 >> v2:172.21.15.93:3300/0 conn(0x7fed2c175590 msgr2=0x7fed2c180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 --2- 172.21.15.62:0/765663485 >> v2:172.21.15.93:3300/0 conn(0x7fed2c175590 0x7fed2c180d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c0f0840 con 0x7fed2c1751b0 2022-09-17T10:28:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7fed1c001470 con 0x7fed2c1751b0 2022-09-17T10:28:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 >> v1:172.21.15.62:6789/0 conn(0x7fed2c1751b0 legacy=0x7fed2c180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed18003930 0x7fed18003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed18004690 0x7fed18004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18005000 0x7fed1800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0f10e0 con 0x7fed18003930 2022-09-17T10:28:07.399 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c1801e0 con 0x7fed18004690 2022-09-17T10:28:07.399 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1800bf30 con 0x7fed18005000 2022-09-17T10:28:07.399 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2b7fe700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed18003930 0x7fed18003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2affd700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed18004690 0x7fed18004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.380+0000 7fed2bfff700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18005000 0x7fed1800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2b7fe700 1 -- 172.21.15.62:0/765663485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18005000 msgr2=0x7fed1800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2b7fe700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18005000 0x7fed1800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2b7fe700 1 -- 172.21.15.62:0/765663485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed18004690 msgr2=0x7fed18004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:07.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2b7fe700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed18004690 0x7fed18004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2bfff700 1 -- 172.21.15.62:0/765663485 reap_dead start 2022-09-17T10:28:07.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2b7fe700 1 -- 172.21.15.62:0/765663485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180033f0 con 0x7fed18003930 2022-09-17T10:28:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2b7fe700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed18003930 0x7fed18003d50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fed1c007b80 tx=0x7fed1c001e90).ready entity=mon.0 client_cookie=85ad765e67b8a5d5 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c015a90 con 0x7fed18003930 2022-09-17T10:28:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c015bf0 con 0x7fed18003930 2022-09-17T10:28:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed2a7fc700 1 -- 172.21.15.62:0/765663485 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00c900 con 0x7fed18003930 2022-09-17T10:28:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed31c35700 1 -- 172.21.15.62:0/765663485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed18003930 msgr2=0x7fed18003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed31c35700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed18003930 0x7fed18003d50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fed1c007b80 tx=0x7fed1c001e90).stop 2022-09-17T10:28:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed31c35700 1 -- 172.21.15.62:0/765663485 shutdown_connections 2022-09-17T10:28:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed31c35700 1 --2- 172.21.15.62:0/765663485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed18003930 0x7fed18003d50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.381+0000 7fed31c35700 1 -- 172.21.15.62:0/765663485 >> 172.21.15.62:0/765663485 conn(0x7fed2c06a170 msgr2=0x7fed2c0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.382+0000 7fed31c35700 1 -- 172.21.15.62:0/765663485 shutdown_connections 2022-09-17T10:28:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.382+0000 7fed31c35700 1 -- 172.21.15.62:0/765663485 wait complete. 2022-09-17T10:28:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.383+0000 7fed31c35700 1 Processor -- start 2022-09-17T10:28:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.383+0000 7fed31c35700 1 -- start start 2022-09-17T10:28:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed31c35700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18003930 0x7fed2c166860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed31c35700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed2c166d50 0x7fed2c084390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed31c35700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed2c084880 0x7fed2c16d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed31c35700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c1671d0 con 0x7fed2c166d50 2022-09-17T10:28:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed31c35700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c167330 con 0x7fed2c084880 2022-09-17T10:28:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed31c35700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c168190 con 0x7fed18003930 2022-09-17T10:28:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed2c166d50 0x7fed2c084390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed2c166d50 0x7fed2c084390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50046/0 (socket says 172.21.15.62:50046) 2022-09-17T10:28:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2affd700 1 -- 172.21.15.62:0/2023610696 learned_addr learned my addr 172.21.15.62:0/2023610696 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2b7fe700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18003930 0x7fed2c166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2affd700 1 -- 172.21.15.62:0/2023610696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18003930 msgr2=0x7fed2c166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2affd700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18003930 0x7fed2c166860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2affd700 1 -- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed2c084880 msgr2=0x7fed2c16d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2bfff700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed2c084880 0x7fed2c16d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.409 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2affd700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed2c084880 0x7fed2c16d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.409 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.384+0000 7fed2affd700 1 -- 172.21.15.62:0/2023610696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c167580 con 0x7fed2c166d50 2022-09-17T10:28:07.409 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.385+0000 7fed2b7fe700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18003930 0x7fed2c166860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:07.409 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.385+0000 7fed2affd700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed2c166d50 0x7fed2c084390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fed20011a00 tx=0x7fed20009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.409 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.385+0000 7fed137fe700 1 -- 172.21.15.62:0/2023610696 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20011e70 con 0x7fed2c166d50 2022-09-17T10:28:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.385+0000 7fed137fe700 1 -- 172.21.15.62:0/2023610696 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000f860 con 0x7fed2c166d50 2022-09-17T10:28:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.385+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c167860 con 0x7fed2c166d50 2022-09-17T10:28:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.385+0000 7fed137fe700 1 -- 172.21.15.62:0/2023610696 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000fbe0 con 0x7fed2c166d50 2022-09-17T10:28:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.385+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c167e20 con 0x7fed2c166d50 2022-09-17T10:28:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.386+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c06bf40 con 0x7fed2c166d50 2022-09-17T10:28:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.386+0000 7fed137fe700 1 -- 172.21.15.62:0/2023610696 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fed20024070 con 0x7fed2c166d50 2022-09-17T10:28:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.387+0000 7fed137fe700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fed0c08ba40 0x7fed0c08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.387+0000 7fed137fe700 1 -- 172.21.15.62:0/2023610696 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fed200b10a0 con 0x7fed2c166d50 2022-09-17T10:28:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.387+0000 7fed2b7fe700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fed0c08ba40 0x7fed0c08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.388+0000 7fed2b7fe700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fed0c08ba40 0x7fed0c08df00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fed1c001ed0 tx=0x7fed1c01b000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.413 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.391+0000 7fed137fe700 1 -- 172.21.15.62:0/2023610696 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fed20081d60 con 0x7fed2c166d50 2022-09-17T10:28:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.564+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fed2c0f0b20 con 0x7fed2c166d50 2022-09-17T10:28:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.564+0000 7fed137fe700 1 -- 172.21.15.62:0/2023610696 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed200aee60 con 0x7fed2c166d50 2022-09-17T10:28:07.567 INFO:teuthology.orchestra.run.smithi062.stdout:73014444042 2022-09-17T10:28:07.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fed0c08ba40 msgr2=0x7fed0c08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.569 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fed0c08ba40 0x7fed0c08df00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fed1c001ed0 tx=0x7fed1c01b000).stop 2022-09-17T10:28:07.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed2c166d50 msgr2=0x7fed2c084390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.570 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed2c166d50 0x7fed2c084390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fed20011a00 tx=0x7fed20009060).stop 2022-09-17T10:28:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 shutdown_connections 2022-09-17T10:28:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fed0c08ba40 0x7fed0c08df00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed2c084880 0x7fed2c16d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed18003930 0x7fed2c166860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.572 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 --2- 172.21.15.62:0/2023610696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed2c166d50 0x7fed2c084390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.573 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 >> 172.21.15.62:0/2023610696 conn(0x7fed2c06a170 msgr2=0x7fed2c0f1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:07.573 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 shutdown_connections 2022-09-17T10:28:07.574 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.566+0000 7fed31c35700 1 -- 172.21.15.62:0/2023610696 wait complete. 2022-09-17T10:28:07.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.9 2022-09-17T10:28:07.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2022-09-17T10:28:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.697+0000 7f9dbc766700 1 Processor -- start 2022-09-17T10:28:07.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.697+0000 7f9dbc766700 1 -- start start 2022-09-17T10:28:07.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9dbc766700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9db417e3c0 0x7f9db40683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9dbc766700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9db4069db0 0x7f9db417f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9dbc766700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db417f750 con 0x7f9db417dfe0 2022-09-17T10:28:07.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9dbc766700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db406a240 con 0x7f9db4069db0 2022-09-17T10:28:07.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9dbc766700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db4068a30 con 0x7f9db417e3c0 2022-09-17T10:28:07.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9dba502700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9db417dfe0 0x7f9db4084010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57792/0 (socket says 172.21.15.62:57792) 2022-09-17T10:28:07.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9dba502700 1 -- 172.21.15.62:0/2091796522 learned_addr learned my addr 172.21.15.62:0/2091796522 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:07.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9db9d01700 1 --2- 172.21.15.62:0/2091796522 >> v2:172.21.15.159:3300/0 conn(0x7f9db417e3c0 0x7f9db40683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9dbad03700 1 --2- 172.21.15.62:0/2091796522 >> v2:172.21.15.93:3300/0 conn(0x7f9db4069db0 0x7f9db417f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444552396 0 0) 0x7f9db417f750 con 0x7f9db417dfe0 2022-09-17T10:28:07.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.698+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da00033f0 con 0x7f9db417dfe0 2022-09-17T10:28:07.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4168493992 0 0) 0x7f9da00033f0 con 0x7f9db417dfe0 2022-09-17T10:28:07.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 >> v2:172.21.15.159:3300/0 conn(0x7f9db417e3c0 msgr2=0x7f9db40683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:07.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 --2- 172.21.15.62:0/2091796522 >> v2:172.21.15.159:3300/0 conn(0x7f9db417e3c0 0x7f9db40683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 >> v2:172.21.15.93:3300/0 conn(0x7f9db4069db0 msgr2=0x7f9db417f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:07.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 --2- 172.21.15.62:0/2091796522 >> v2:172.21.15.93:3300/0 conn(0x7f9db4069db0 0x7f9db417f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4068d10 con 0x7f9db417dfe0 2022-09-17T10:28:07.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f9dac001470 con 0x7f9db417dfe0 2022-09-17T10:28:07.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dbad03700 1 --2- 172.21.15.62:0/2091796522 >> v2:172.21.15.93:3300/0 conn(0x7f9db4069db0 0x7f9db417f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:28:07.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 >> v1:172.21.15.62:6789/0 conn(0x7f9db417dfe0 legacy=0x7f9db4084010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9da0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9da0004690 0x7f9da0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da0005000 0x7f9da000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db406a240 con 0x7f9da0003930 2022-09-17T10:28:07.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4068a30 con 0x7f9da0004690 2022-09-17T10:28:07.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da000bf30 con 0x7f9da0005000 2022-09-17T10:28:07.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dba502700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9da0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9d01700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9da0004690 0x7f9da0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dbad03700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da0005000 0x7f9da000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dba502700 1 -- 172.21.15.62:0/2091796522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da0005000 msgr2=0x7f9da000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:07.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dba502700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da0005000 0x7f9da000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dba502700 1 -- 172.21.15.62:0/2091796522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9da0004690 msgr2=0x7f9da0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:07.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dba502700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9da0004690 0x7f9da0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dba502700 1 -- 172.21.15.62:0/2091796522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00033f0 con 0x7f9da0003930 2022-09-17T10:28:07.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dbad03700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da0005000 0x7f9da000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:07.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dbad03700 1 -- 172.21.15.62:0/2091796522 reap_dead start 2022-09-17T10:28:07.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9dba502700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9da0003d50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f9dac00c190 tx=0x7f9dac001e50).ready entity=mon.0 client_cookie=52314119f68e7a6c server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007a20 con 0x7f9da0003930 2022-09-17T10:28:07.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00cac0 con 0x7f9da0003930 2022-09-17T10:28:07.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.699+0000 7f9db9500700 1 -- 172.21.15.62:0/2091796522 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00ce60 con 0x7f9da0003930 2022-09-17T10:28:07.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.700+0000 7f9dbc766700 1 -- 172.21.15.62:0/2091796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 msgr2=0x7f9da0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.700+0000 7f9dbc766700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9da0003d50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f9dac00c190 tx=0x7f9dac001e50).stop 2022-09-17T10:28:07.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.700+0000 7f9dbc766700 1 -- 172.21.15.62:0/2091796522 shutdown_connections 2022-09-17T10:28:07.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.700+0000 7f9dbc766700 1 --2- 172.21.15.62:0/2091796522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9da0003d50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.700+0000 7f9dbc766700 1 -- 172.21.15.62:0/2091796522 >> 172.21.15.62:0/2091796522 conn(0x7f9db4062a40 msgr2=0x7f9db40f2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:07.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.700+0000 7f9dbc766700 1 -- 172.21.15.62:0/2091796522 shutdown_connections 2022-09-17T10:28:07.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.700+0000 7f9dbc766700 1 -- 172.21.15.62:0/2091796522 wait complete. 2022-09-17T10:28:07.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.701+0000 7f9dbc766700 1 Processor -- start 2022-09-17T10:28:07.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.701+0000 7f9dbc766700 1 -- start start 2022-09-17T10:28:07.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dbc766700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9db40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dbc766700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db40851d0 0x7f9db416fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dbc766700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db418ffa0 0x7f9db4190420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dbc766700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40c73a0 con 0x7f9da0003930 2022-09-17T10:28:07.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dbc766700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db418fb50 con 0x7f9db418ffa0 2022-09-17T10:28:07.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dbc766700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40c8120 con 0x7f9db40851d0 2022-09-17T10:28:07.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dba502700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9db40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dba502700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9db40c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50056/0 (socket says 172.21.15.62:50056) 2022-09-17T10:28:07.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.702+0000 7f9dba502700 1 -- 172.21.15.62:0/3089430062 learned_addr learned my addr 172.21.15.62:0/3089430062 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:07.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9db9d01700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db40851d0 0x7f9db416fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dbad03700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db418ffa0 0x7f9db4190420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dba502700 1 -- 172.21.15.62:0/3089430062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db40851d0 msgr2=0x7f9db416fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dba502700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db40851d0 0x7f9db416fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dba502700 1 -- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db418ffa0 msgr2=0x7f9db4190420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dba502700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db418ffa0 0x7f9db4190420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dba502700 1 -- 172.21.15.62:0/3089430062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40c75a0 con 0x7f9da0003930 2022-09-17T10:28:07.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dba502700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9db40c6eb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f9dac00c780 tx=0x7f9dac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9db27fc700 1 -- 172.21.15.62:0/3089430062 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007640 con 0x7f9da0003930 2022-09-17T10:28:07.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9db27fc700 1 -- 172.21.15.62:0/3089430062 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac0046b0 con 0x7f9da0003930 2022-09-17T10:28:07.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db40c7880 con 0x7f9da0003930 2022-09-17T10:28:07.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9db27fc700 1 -- 172.21.15.62:0/3089430062 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac004a70 con 0x7f9da0003930 2022-09-17T10:28:07.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.703+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db40c7e40 con 0x7f9da0003930 2022-09-17T10:28:07.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.704+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db418fdf0 con 0x7f9da0003930 2022-09-17T10:28:07.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.705+0000 7f9db27fc700 1 -- 172.21.15.62:0/3089430062 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f9dac010070 con 0x7f9da0003930 2022-09-17T10:28:07.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.706+0000 7f9db27fc700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9d9408ba40 0x7f9d9408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:07.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.706+0000 7f9db27fc700 1 -- 172.21.15.62:0/3089430062 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f9dac0b0f00 con 0x7f9da0003930 2022-09-17T10:28:07.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.706+0000 7f9db9d01700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9d9408ba40 0x7f9d9408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:07.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.706+0000 7f9db9d01700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9d9408ba40 0x7f9d9408df00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9da8006920 tx=0x7f9da8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:07.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.710+0000 7f9db27fc700 1 -- 172.21.15.62:0/3089430062 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f9dac081bc0 con 0x7f9da0003930 2022-09-17T10:28:07.886 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.884+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f9db40f3860 con 0x7f9da0003930 2022-09-17T10:28:07.887 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.884+0000 7f9db27fc700 1 -- 172.21.15.62:0/3089430062 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f9dac025070 con 0x7f9da0003930 2022-09-17T10:28:07.887 INFO:teuthology.orchestra.run.smithi062.stdout:73014444041 2022-09-17T10:28:07.890 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9d9408ba40 msgr2=0x7f9d9408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.891 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9d9408ba40 0x7f9d9408df00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9da8006920 tx=0x7f9da8008040).stop 2022-09-17T10:28:07.891 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 msgr2=0x7f9db40c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:07.892 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9db40c6eb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f9dac00c780 tx=0x7f9dac015000).stop 2022-09-17T10:28:07.892 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 shutdown_connections 2022-09-17T10:28:07.893 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9d9408ba40 0x7f9d9408df00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.893 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db418ffa0 0x7f9db4190420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.894 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9da0003930 0x7f9db40c6eb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.894 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 --2- 172.21.15.62:0/3089430062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9db40851d0 0x7f9db416fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:07.894 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 >> 172.21.15.62:0/3089430062 conn(0x7f9db4062a40 msgr2=0x7f9db4171bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:07.895 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 shutdown_connections 2022-09-17T10:28:07.895 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:07.886+0000 7f9dbc766700 1 -- 172.21.15.62:0/3089430062 wait complete. 2022-09-17T10:28:07.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.10 2022-09-17T10:28:07.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2022-09-17T10:28:08.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.017+0000 7fb357884700 1 Processor -- start 2022-09-17T10:28:08.019 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.017+0000 7fb357884700 1 -- start start 2022-09-17T10:28:08.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb357884700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb350175590 0x7fb350180d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb357884700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb3500ef650 0x7fb3500efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb357884700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3500c6dd0 con 0x7fb3501751b0 2022-09-17T10:28:08.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb357884700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3500f10e0 con 0x7fb3500ef650 2022-09-17T10:28:08.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb357884700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3501801e0 con 0x7fb350175590 2022-09-17T10:28:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb354e1f700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb350175590 0x7fb350180d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb355620700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fb3501751b0 0x7fb350180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.62:40982/0 (socket says 172.21.15.62:40982) 2022-09-17T10:28:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb355620700 1 -- 172.21.15.62:0/507646671 learned_addr learned my addr 172.21.15.62:0/507646671 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.018+0000 7fb355e21700 1 --2- 172.21.15.62:0/507646671 >> v2:172.21.15.93:3300/0 conn(0x7fb3500ef650 0x7fb3500efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb354e1f700 1 -- 172.21.15.62:0/507646671 >> v2:172.21.15.93:3300/0 conn(0x7fb3500ef650 msgr2=0x7fb3500efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:08.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb354e1f700 1 --2- 172.21.15.62:0/507646671 >> v2:172.21.15.93:3300/0 conn(0x7fb3500ef650 0x7fb3500efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb354e1f700 1 -- 172.21.15.62:0/507646671 >> v1:172.21.15.159:6789/0 conn(0x7fb3501751b0 legacy=0x7fb350180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb354e1f700 1 -- 172.21.15.62:0/507646671 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500f0840 con 0x7fb350175590 2022-09-17T10:28:08.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb33ffff700 1 -- 172.21.15.62:0/507646671 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232052823 0 0) 0x7fb3500c6dd0 con 0x7fb3501751b0 2022-09-17T10:28:08.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb354e1f700 1 --2- 172.21.15.62:0/507646671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb350175590 0x7fb350180d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb350085780 tx=0x7fb340009060).ready entity=mon.2 client_cookie=add0e1ac21deff4 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb33ffff700 1 -- 172.21.15.62:0/507646671 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400090d0 con 0x7fb350175590 2022-09-17T10:28:08.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb33ffff700 1 -- 172.21.15.62:0/507646671 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000f510 con 0x7fb350175590 2022-09-17T10:28:08.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb33ffff700 1 -- 172.21.15.62:0/507646671 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000f890 con 0x7fb350175590 2022-09-17T10:28:08.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb357884700 1 -- 172.21.15.62:0/507646671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb350175590 msgr2=0x7fb350180d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb357884700 1 --2- 172.21.15.62:0/507646671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb350175590 0x7fb350180d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb350085780 tx=0x7fb340009060).stop 2022-09-17T10:28:08.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb357884700 1 -- 172.21.15.62:0/507646671 shutdown_connections 2022-09-17T10:28:08.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb357884700 1 --2- 172.21.15.62:0/507646671 >> v2:172.21.15.93:3300/0 conn(0x7fb3500ef650 0x7fb3500efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb357884700 1 --2- 172.21.15.62:0/507646671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb350175590 0x7fb350180d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.019+0000 7fb357884700 1 -- 172.21.15.62:0/507646671 >> 172.21.15.62:0/507646671 conn(0x7fb35006a170 msgr2=0x7fb3500f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:08.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.020+0000 7fb357884700 1 -- 172.21.15.62:0/507646671 shutdown_connections 2022-09-17T10:28:08.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.020+0000 7fb357884700 1 -- 172.21.15.62:0/507646671 wait complete. 2022-09-17T10:28:08.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.021+0000 7fb357884700 1 Processor -- start 2022-09-17T10:28:08.030 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.021+0000 7fb357884700 1 -- start start 2022-09-17T10:28:08.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb357884700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3500ef650 0x7fb350192520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb357884700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3501751b0 0x7fb350192a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb357884700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb350175590 0x7fb35016dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb357884700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35017c430 con 0x7fb3501751b0 2022-09-17T10:28:08.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb357884700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35017ccd0 con 0x7fb350175590 2022-09-17T10:28:08.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb357884700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c8370 con 0x7fb3500ef650 2022-09-17T10:28:08.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb354e1f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3501751b0 0x7fb350192a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb354e1f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3501751b0 0x7fb350192a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50068/0 (socket says 172.21.15.62:50068) 2022-09-17T10:28:08.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb354e1f700 1 -- 172.21.15.62:0/3391567840 learned_addr learned my addr 172.21.15.62:0/3391567840 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:08.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb355620700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3500ef650 0x7fb350192520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.022+0000 7fb355e21700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb350175590 0x7fb35016dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb354e1f700 1 -- 172.21.15.62:0/3391567840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3500ef650 msgr2=0x7fb350192520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb354e1f700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3500ef650 0x7fb350192520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb354e1f700 1 -- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb350175590 msgr2=0x7fb35016dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb354e1f700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb350175590 0x7fb35016dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb354e1f700 1 -- 172.21.15.62:0/3391567840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400092a0 con 0x7fb3501751b0 2022-09-17T10:28:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb355e21700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb350175590 0x7fb35016dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb354e1f700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3501751b0 0x7fb350192a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb340009dd0 tx=0x7fb340017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb33d7fa700 1 -- 172.21.15.62:0/3391567840 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340006970 con 0x7fb3501751b0 2022-09-17T10:28:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb33d7fa700 1 -- 172.21.15.62:0/3391567840 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000fc50 con 0x7fb3501751b0 2022-09-17T10:28:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3500c8650 con 0x7fb3501751b0 2022-09-17T10:28:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb33d7fa700 1 -- 172.21.15.62:0/3391567840 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000f890 con 0x7fb3501751b0 2022-09-17T10:28:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.023+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35017c960 con 0x7fb3501751b0 2022-09-17T10:28:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.024+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35006bf40 con 0x7fb3501751b0 2022-09-17T10:28:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.025+0000 7fb33d7fa700 1 -- 172.21.15.62:0/3391567840 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb34000f070 con 0x7fb3501751b0 2022-09-17T10:28:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.025+0000 7fb33d7fa700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb33008ba40 0x7fb33008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.025+0000 7fb33d7fa700 1 -- 172.21.15.62:0/3391567840 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb3400b1ba0 con 0x7fb3501751b0 2022-09-17T10:28:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.025+0000 7fb355620700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb33008ba40 0x7fb33008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.026+0000 7fb355620700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb33008ba40 0x7fb33008df00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fb34c0011e0 tx=0x7fb34c007bb0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.029+0000 7fb33d7fa700 1 -- 172.21.15.62:0/3391567840 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fb340082860 con 0x7fb3501751b0 2022-09-17T10:28:08.204 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.202+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fb3500f0b20 con 0x7fb3501751b0 2022-09-17T10:28:08.205 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.203+0000 7fb33d7fa700 1 -- 172.21.15.62:0/3391567840 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fb34001f070 con 0x7fb3501751b0 2022-09-17T10:28:08.205 INFO:teuthology.orchestra.run.smithi062.stdout:73014444042 2022-09-17T10:28:08.207 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb33008ba40 msgr2=0x7fb33008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.207 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb33008ba40 0x7fb33008df00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fb34c0011e0 tx=0x7fb34c007bb0).stop 2022-09-17T10:28:08.207 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3501751b0 msgr2=0x7fb350192a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.208 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3501751b0 0x7fb350192a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb340009dd0 tx=0x7fb340017000).stop 2022-09-17T10:28:08.208 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 shutdown_connections 2022-09-17T10:28:08.208 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb33008ba40 0x7fb33008df00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.208 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb350175590 0x7fb35016dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.209 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3500ef650 0x7fb350192520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.209 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 --2- 172.21.15.62:0/3391567840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3501751b0 0x7fb350192a10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.209 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 >> 172.21.15.62:0/3391567840 conn(0x7fb35006a170 msgr2=0x7fb35016eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:08.209 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 shutdown_connections 2022-09-17T10:28:08.210 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.204+0000 7fb357884700 1 -- 172.21.15.62:0/3391567840 wait complete. 2022-09-17T10:28:08.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.11 2022-09-17T10:28:08.219 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-09-17T10:28:08.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-09-17T10:28:08.338 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.335+0000 7fe3a08cd700 1 Processor -- start 2022-09-17T10:28:08.338 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.335+0000 7fe3a08cd700 1 -- start start 2022-09-17T10:28:08.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.336+0000 7fe3a08cd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe39c1751b0 0x7fe39c180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.336+0000 7fe3a08cd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe39c0ef650 0x7fe39c0efa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.349 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.336+0000 7fe3a08cd700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c0c6dd0 con 0x7fe39c175590 2022-09-17T10:28:08.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.336+0000 7fe3a08cd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0f10e0 con 0x7fe39c1751b0 2022-09-17T10:28:08.350 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.336+0000 7fe3a08cd700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c1801e0 con 0x7fe39c0ef650 2022-09-17T10:28:08.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe39c1751b0 0x7fe39c180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe39c1751b0 0x7fe39c180670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50084/0 (socket says 172.21.15.62:50084) 2022-09-17T10:28:08.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39a59c700 1 -- 172.21.15.62:0/4091135525 learned_addr learned my addr 172.21.15.62:0/4091135525 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:08.351 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39ad9d700 1 --2- 172.21.15.62:0/4091135525 >> v2:172.21.15.159:3300/0 conn(0x7fe39c0ef650 0x7fe39c0efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39a59c700 1 -- 172.21.15.62:0/4091135525 >> v2:172.21.15.159:3300/0 conn(0x7fe39c0ef650 msgr2=0x7fe39c0efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:08.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39a59c700 1 --2- 172.21.15.62:0/4091135525 >> v2:172.21.15.159:3300/0 conn(0x7fe39c0ef650 0x7fe39c0efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39a59c700 1 -- 172.21.15.62:0/4091135525 >> v1:172.21.15.159:6789/0 conn(0x7fe39c175590 legacy=0x7fe39c180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39a59c700 1 -- 172.21.15.62:0/4091135525 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0f0840 con 0x7fe39c1751b0 2022-09-17T10:28:08.352 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39a59c700 1 --2- 172.21.15.62:0/4091135525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c180670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe39c088650 tx=0x7fe3940090f0).ready entity=mon.0 client_cookie=7a86783e3a6c1aa server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39959a700 1 -- 172.21.15.62:0/4091135525 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400b600 con 0x7fe39c1751b0 2022-09-17T10:28:08.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39959a700 1 -- 172.21.15.62:0/4091135525 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400b760 con 0x7fe39c1751b0 2022-09-17T10:28:08.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.337+0000 7fe39959a700 1 -- 172.21.15.62:0/4091135525 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400bb00 con 0x7fe39c1751b0 2022-09-17T10:28:08.353 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.338+0000 7fe3a08cd700 1 -- 172.21.15.62:0/4091135525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 msgr2=0x7fe39c180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.338+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/4091135525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c180670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe39c088650 tx=0x7fe3940090f0).stop 2022-09-17T10:28:08.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.338+0000 7fe3a08cd700 1 -- 172.21.15.62:0/4091135525 shutdown_connections 2022-09-17T10:28:08.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.338+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/4091135525 >> v2:172.21.15.159:3300/0 conn(0x7fe39c0ef650 0x7fe39c0efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.354 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.338+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/4091135525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c180670 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.338+0000 7fe3a08cd700 1 -- 172.21.15.62:0/4091135525 >> 172.21.15.62:0/4091135525 conn(0x7fe39c06a170 msgr2=0x7fe39c0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:08.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.338+0000 7fe3a08cd700 1 -- 172.21.15.62:0/4091135525 shutdown_connections 2022-09-17T10:28:08.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.338+0000 7fe3a08cd700 1 -- 172.21.15.62:0/4091135525 wait complete. 2022-09-17T10:28:08.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.339+0000 7fe3a08cd700 1 Processor -- start 2022-09-17T10:28:08.355 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.339+0000 7fe3a08cd700 1 -- start start 2022-09-17T10:28:08.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.340+0000 7fe3a08cd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe39c0ef650 0x7fe39c086680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.340+0000 7fe3a08cd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.340+0000 7fe3a08cd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe39c175590 0x7fe39c168d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.356 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.340+0000 7fe3a08cd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0884c0 con 0x7fe39c1751b0 2022-09-17T10:28:08.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.340+0000 7fe3a08cd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0861f0 con 0x7fe39c175590 2022-09-17T10:28:08.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.340+0000 7fe3a08cd700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0f2370 con 0x7fe39c0ef650 2022-09-17T10:28:08.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c0c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50098/0 (socket says 172.21.15.62:50098) 2022-09-17T10:28:08.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 -- 172.21.15.62:0/905134863 learned_addr learned my addr 172.21.15.62:0/905134863 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:08.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe39a59c700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe39c0ef650 0x7fe39c086680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe39ad9d700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe39c175590 0x7fe39c168d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 -- 172.21.15.62:0/905134863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe39c0ef650 msgr2=0x7fe39c086680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe39c0ef650 0x7fe39c086680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 -- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe39c175590 msgr2=0x7fe39c168d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe39c175590 0x7fe39c168d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.359 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 -- 172.21.15.62:0/905134863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394009370 con 0x7fe39c1751b0 2022-09-17T10:28:08.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe39ad9d700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe39c175590 0x7fe39c168d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:08.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe399d9b700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c0c7c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe38400c440 tx=0x7fe384007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.360 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe3927fc700 1 -- 172.21.15.62:0/905134863 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38400ce40 con 0x7fe39c1751b0 2022-09-17T10:28:08.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe3927fc700 1 -- 172.21.15.62:0/905134863 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe384007020 con 0x7fe39c1751b0 2022-09-17T10:28:08.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe3927fc700 1 -- 172.21.15.62:0/905134863 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3840073c0 con 0x7fe39c1751b0 2022-09-17T10:28:08.361 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c0f2650 con 0x7fe39c1751b0 2022-09-17T10:28:08.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.341+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c085ba0 con 0x7fe39c1751b0 2022-09-17T10:28:08.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.342+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c0863a0 con 0x7fe39c1751b0 2022-09-17T10:28:08.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.343+0000 7fe3927fc700 1 -- 172.21.15.62:0/905134863 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe384010070 con 0x7fe39c1751b0 2022-09-17T10:28:08.362 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.343+0000 7fe3927fc700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe38008ba40 0x7fe38008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.344+0000 7fe3927fc700 1 -- 172.21.15.62:0/905134863 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fe3840afaa0 con 0x7fe39c1751b0 2022-09-17T10:28:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.344+0000 7fe39a59c700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe38008ba40 0x7fe38008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.344+0000 7fe39a59c700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe38008ba40 0x7fe38008df00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe39400b3c0 tx=0x7fe394017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.364 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.347+0000 7fe3927fc700 1 -- 172.21.15.62:0/905134863 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fe39c0863a0 con 0x7fe39c1751b0 2022-09-17T10:28:08.516 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.514+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 --> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe39c086360 con 0x7fe38008ba40 2022-09-17T10:28:08.529 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.527+0000 7fe3927fc700 1 -- 172.21.15.62:0/905134863 <== mgr.4114 v2:172.21.15.93:6832/81423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434667 (secure 0 0 0) 0x7fe39c086360 con 0x7fe38008ba40 2022-09-17T10:28:08.535 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:08.541 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe38008ba40 msgr2=0x7fe38008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.541 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe38008ba40 0x7fe38008df00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe39400b3c0 tx=0x7fe394017000).stop 2022-09-17T10:28:08.542 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 msgr2=0x7fe39c0c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.542 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c0c7c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe38400c440 tx=0x7fe384007e00).stop 2022-09-17T10:28:08.542 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 shutdown_connections 2022-09-17T10:28:08.543 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe38008ba40 0x7fe38008df00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.543 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe39c175590 0x7fe39c168d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe39c0ef650 0x7fe39c086680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 --2- 172.21.15.62:0/905134863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe39c1751b0 0x7fe39c0c7c10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 >> 172.21.15.62:0/905134863 conn(0x7fe39c06a170 msgr2=0x7fe39c0849c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 shutdown_connections 2022-09-17T10:28:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.531+0000 7fe3a08cd700 1 -- 172.21.15.62:0/905134863 wait complete. 2022-09-17T10:28:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2022-09-17T10:28:08.547 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2022-09-17T10:28:06.882959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":63968,"kb_used_data":3904,"kb_used_omap":0,"kb_used_meta":59968,"kb_avail":1132398112,"statfs":{"total":1159641169920,"available":1159575666688,"internally_reserved":0,"allocated":3997696,"data_stored":1942926,"data_compressed":133308,"data_compressed_allocated":196608,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":61407232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003827"},"pg_stats":[{"pgid":"3.3f","version":"26'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.205131+0000","last_change":"2022-09-17T10:27:42.422299+0000","last_active":"2022-09-17T10:27:47.205131+0000","last_peered":"2022-09-17T10:27:47.205131+0000","last_clean":"2022-09-17T10:27:47.205131+0000","last_became_active":"2022-09-17T10:27:42.421964+0000","last_became_peered":"2022-09-17T10:27:42.421964+0000","last_unstale":"2022-09-17T10:27:47.205131+0000","last_undegraded":"2022-09-17T10:27:47.205131+0000","last_fullsized":"2022-09-17T10:27:47.205131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826597+0000","last_change":"2022-09-17T10:27:42.817398+0000","last_active":"2022-09-17T10:27:46.826597+0000","last_peered":"2022-09-17T10:27:46.826597+0000","last_clean":"2022-09-17T10:27:46.826597+0000","last_became_active":"2022-09-17T10:27:42.816997+0000","last_became_peered":"2022-09-17T10:27:42.816997+0000","last_unstale":"2022-09-17T10:27:46.826597+0000","last_undegraded":"2022-09-17T10:27:46.826597+0000","last_fullsized":"2022-09-17T10:27:46.826597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823263+0000","last_change":"2022-09-17T10:27:42.420800+0000","last_active":"2022-09-17T10:27:46.823263+0000","last_peered":"2022-09-17T10:27:46.823263+0000","last_clean":"2022-09-17T10:27:46.823263+0000","last_became_active":"2022-09-17T10:27:42.420493+0000","last_became_peered":"2022-09-17T10:27:42.420493+0000","last_unstale":"2022-09-17T10:27:46.823263+0000","last_undegraded":"2022-09-17T10:27:46.823263+0000","last_fullsized":"2022-09-17T10:27:46.823263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828146+0000","last_change":"2022-09-17T10:27:42.813032+0000","last_active":"2022-09-17T10:27:46.828146+0000","last_peered":"2022-09-17T10:27:46.828146+0000","last_clean":"2022-09-17T10:27:46.828146+0000","last_became_active":"2022-09-17T10:27:42.812613+0000","last_became_peered":"2022-09-17T10:27:42.812613+0000","last_unstale":"2022-09-17T10:27:46.828146+0000","last_undegraded":"2022-09-17T10:27:46.828146+0000","last_fullsized":"2022-09-17T10:27:46.828146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823043+0000","last_change":"2022-09-17T10:27:42.419699+0000","last_active":"2022-09-17T10:27:46.823043+0000","last_peered":"2022-09-17T10:27:46.823043+0000","last_clean":"2022-09-17T10:27:46.823043+0000","last_became_active":"2022-09-17T10:27:42.419381+0000","last_became_peered":"2022-09-17T10:27:42.419381+0000","last_unstale":"2022-09-17T10:27:46.823043+0000","last_undegraded":"2022-09-17T10:27:46.823043+0000","last_fullsized":"2022-09-17T10:27:46.823043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821000+0000","last_change":"2022-09-17T10:27:42.812216+0000","last_active":"2022-09-17T10:27:46.821000+0000","last_peered":"2022-09-17T10:27:46.821000+0000","last_clean":"2022-09-17T10:27:46.821000+0000","last_became_active":"2022-09-17T10:27:42.811495+0000","last_became_peered":"2022-09-17T10:27:42.811495+0000","last_unstale":"2022-09-17T10:27:46.821000+0000","last_undegraded":"2022-09-17T10:27:46.821000+0000","last_fullsized":"2022-09-17T10:27:46.821000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821860+0000","last_change":"2022-09-17T10:27:42.423214+0000","last_active":"2022-09-17T10:27:46.821860+0000","last_peered":"2022-09-17T10:27:46.821860+0000","last_clean":"2022-09-17T10:27:46.821860+0000","last_became_active":"2022-09-17T10:27:42.422645+0000","last_became_peered":"2022-09-17T10:27:42.422645+0000","last_unstale":"2022-09-17T10:27:46.821860+0000","last_undegraded":"2022-09-17T10:27:46.821860+0000","last_fullsized":"2022-09-17T10:27:46.821860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821942+0000","last_change":"2022-09-17T10:27:42.816222+0000","last_active":"2022-09-17T10:27:46.821942+0000","last_peered":"2022-09-17T10:27:46.821942+0000","last_clean":"2022-09-17T10:27:46.821942+0000","last_became_active":"2022-09-17T10:27:42.815835+0000","last_became_peered":"2022-09-17T10:27:42.815835+0000","last_unstale":"2022-09-17T10:27:46.821942+0000","last_undegraded":"2022-09-17T10:27:46.821942+0000","last_fullsized":"2022-09-17T10:27:46.821942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.833135+0000","last_change":"2022-09-17T10:27:42.422984+0000","last_active":"2022-09-17T10:27:46.833135+0000","last_peered":"2022-09-17T10:27:46.833135+0000","last_clean":"2022-09-17T10:27:46.833135+0000","last_became_active":"2022-09-17T10:27:42.422710+0000","last_became_peered":"2022-09-17T10:27:42.422710+0000","last_unstale":"2022-09-17T10:27:46.833135+0000","last_undegraded":"2022-09-17T10:27:46.833135+0000","last_fullsized":"2022-09-17T10:27:46.833135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828197+0000","last_change":"2022-09-17T10:27:42.812970+0000","last_active":"2022-09-17T10:27:46.828197+0000","last_peered":"2022-09-17T10:27:46.828197+0000","last_clean":"2022-09-17T10:27:46.828197+0000","last_became_active":"2022-09-17T10:27:42.812675+0000","last_became_peered":"2022-09-17T10:27:42.812675+0000","last_unstale":"2022-09-17T10:27:46.828197+0000","last_undegraded":"2022-09-17T10:27:46.828197+0000","last_fullsized":"2022-09-17T10:27:46.828197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824416+0000","last_change":"2022-09-17T10:27:42.417757+0000","last_active":"2022-09-17T10:27:46.824416+0000","last_peered":"2022-09-17T10:27:46.824416+0000","last_clean":"2022-09-17T10:27:46.824416+0000","last_became_active":"2022-09-17T10:27:42.417425+0000","last_became_peered":"2022-09-17T10:27:42.417425+0000","last_unstale":"2022-09-17T10:27:46.824416+0000","last_undegraded":"2022-09-17T10:27:46.824416+0000","last_fullsized":"2022-09-17T10:27:46.824416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821143+0000","last_change":"2022-09-17T10:27:42.815053+0000","last_active":"2022-09-17T10:27:46.821143+0000","last_peered":"2022-09-17T10:27:46.821143+0000","last_clean":"2022-09-17T10:27:46.821143+0000","last_became_active":"2022-09-17T10:27:42.814772+0000","last_became_peered":"2022-09-17T10:27:42.814772+0000","last_unstale":"2022-09-17T10:27:46.821143+0000","last_undegraded":"2022-09-17T10:27:46.821143+0000","last_fullsized":"2022-09-17T10:27:46.821143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831182+0000","last_change":"2022-09-17T10:27:42.420271+0000","last_active":"2022-09-17T10:27:46.831182+0000","last_peered":"2022-09-17T10:27:46.831182+0000","last_clean":"2022-09-17T10:27:46.831182+0000","last_became_active":"2022-09-17T10:27:42.419991+0000","last_became_peered":"2022-09-17T10:27:42.419991+0000","last_unstale":"2022-09-17T10:27:46.831182+0000","last_undegraded":"2022-09-17T10:27:46.831182+0000","last_fullsized":"2022-09-17T10:27:46.831182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823843+0000","last_change":"2022-09-17T10:27:42.806227+0000","last_active":"2022-09-17T10:27:46.823843+0000","last_peered":"2022-09-17T10:27:46.823843+0000","last_clean":"2022-09-17T10:27:46.823843+0000","last_became_active":"2022-09-17T10:27:42.805882+0000","last_became_peered":"2022-09-17T10:27:42.805882+0000","last_unstale":"2022-09-17T10:27:46.823843+0000","last_undegraded":"2022-09-17T10:27:46.823843+0000","last_fullsized":"2022-09-17T10:27:46.823843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830859+0000","last_change":"2022-09-17T10:27:42.423044+0000","last_active":"2022-09-17T10:27:46.830859+0000","last_peered":"2022-09-17T10:27:46.830859+0000","last_clean":"2022-09-17T10:27:46.830859+0000","last_became_active":"2022-09-17T10:27:42.421055+0000","last_became_peered":"2022-09-17T10:27:42.421055+0000","last_unstale":"2022-09-17T10:27:46.830859+0000","last_undegraded":"2022-09-17T10:27:46.830859+0000","last_fullsized":"2022-09-17T10:27:46.830859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823833+0000","last_change":"2022-09-17T10:27:42.807118+0000","last_active":"2022-09-17T10:27:46.823833+0000","last_peered":"2022-09-17T10:27:46.823833+0000","last_clean":"2022-09-17T10:27:46.823833+0000","last_became_active":"2022-09-17T10:27:42.806225+0000","last_became_peered":"2022-09-17T10:27:42.806225+0000","last_unstale":"2022-09-17T10:27:46.823833+0000","last_undegraded":"2022-09-17T10:27:46.823833+0000","last_fullsized":"2022-09-17T10:27:46.823833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828853+0000","last_change":"2022-09-17T10:27:42.412247+0000","last_active":"2022-09-17T10:27:46.828853+0000","last_peered":"2022-09-17T10:27:46.828853+0000","last_clean":"2022-09-17T10:27:46.828853+0000","last_became_active":"2022-09-17T10:27:42.411939+0000","last_became_peered":"2022-09-17T10:27:42.411939+0000","last_unstale":"2022-09-17T10:27:46.828853+0000","last_undegraded":"2022-09-17T10:27:46.828853+0000","last_fullsized":"2022-09-17T10:27:46.828853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821076+0000","last_change":"2022-09-17T10:27:42.813817+0000","last_active":"2022-09-17T10:27:46.821076+0000","last_peered":"2022-09-17T10:27:46.821076+0000","last_clean":"2022-09-17T10:27:46.821076+0000","last_became_active":"2022-09-17T10:27:42.811044+0000","last_became_peered":"2022-09-17T10:27:42.811044+0000","last_unstale":"2022-09-17T10:27:46.821076+0000","last_undegraded":"2022-09-17T10:27:46.821076+0000","last_fullsized":"2022-09-17T10:27:46.821076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824466+0000","last_change":"2022-09-17T10:27:42.424111+0000","last_active":"2022-09-17T10:27:46.824466+0000","last_peered":"2022-09-17T10:27:46.824466+0000","last_clean":"2022-09-17T10:27:46.824466+0000","last_became_active":"2022-09-17T10:27:42.423848+0000","last_became_peered":"2022-09-17T10:27:42.423848+0000","last_unstale":"2022-09-17T10:27:46.824466+0000","last_undegraded":"2022-09-17T10:27:46.824466+0000","last_fullsized":"2022-09-17T10:27:46.824466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826305+0000","last_change":"2022-09-17T10:27:42.812631+0000","last_active":"2022-09-17T10:27:46.826305+0000","last_peered":"2022-09-17T10:27:46.826305+0000","last_clean":"2022-09-17T10:27:46.826305+0000","last_became_active":"2022-09-17T10:27:42.812131+0000","last_became_peered":"2022-09-17T10:27:42.812131+0000","last_unstale":"2022-09-17T10:27:46.826305+0000","last_undegraded":"2022-09-17T10:27:46.826305+0000","last_fullsized":"2022-09-17T10:27:46.826305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828342+0000","last_change":"2022-09-17T10:27:42.423717+0000","last_active":"2022-09-17T10:27:46.828342+0000","last_peered":"2022-09-17T10:27:46.828342+0000","last_clean":"2022-09-17T10:27:46.828342+0000","last_became_active":"2022-09-17T10:27:42.423419+0000","last_became_peered":"2022-09-17T10:27:42.423419+0000","last_unstale":"2022-09-17T10:27:46.828342+0000","last_undegraded":"2022-09-17T10:27:46.828342+0000","last_fullsized":"2022-09-17T10:27:46.828342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826766+0000","last_change":"2022-09-17T10:27:42.815134+0000","last_active":"2022-09-17T10:27:46.826766+0000","last_peered":"2022-09-17T10:27:46.826766+0000","last_clean":"2022-09-17T10:27:46.826766+0000","last_became_active":"2022-09-17T10:27:42.814787+0000","last_became_peered":"2022-09-17T10:27:42.814787+0000","last_unstale":"2022-09-17T10:27:46.826766+0000","last_undegraded":"2022-09-17T10:27:46.826766+0000","last_fullsized":"2022-09-17T10:27:46.826766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:28:01.975136+0000","last_change":"2022-09-17T10:27:42.420222+0000","last_active":"2022-09-17T10:28:01.975136+0000","last_peered":"2022-09-17T10:28:01.975136+0000","last_clean":"2022-09-17T10:28:01.975136+0000","last_became_active":"2022-09-17T10:27:42.419931+0000","last_became_peered":"2022-09-17T10:27:42.419931+0000","last_unstale":"2022-09-17T10:28:01.975136+0000","last_undegraded":"2022-09-17T10:28:01.975136+0000","last_fullsized":"2022-09-17T10:28:01.975136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3071,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828436+0000","last_change":"2022-09-17T10:27:42.819910+0000","last_active":"2022-09-17T10:27:46.828436+0000","last_peered":"2022-09-17T10:27:46.828436+0000","last_clean":"2022-09-17T10:27:46.828436+0000","last_became_active":"2022-09-17T10:27:42.819746+0000","last_became_peered":"2022-09-17T10:27:42.819746+0000","last_unstale":"2022-09-17T10:27:46.828436+0000","last_undegraded":"2022-09-17T10:27:46.828436+0000","last_fullsized":"2022-09-17T10:27:46.828436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877176+0000","last_change":"2022-09-17T10:27:42.415809+0000","last_active":"2022-09-17T10:27:46.877176+0000","last_peered":"2022-09-17T10:27:46.877176+0000","last_clean":"2022-09-17T10:27:46.877176+0000","last_became_active":"2022-09-17T10:27:42.415484+0000","last_became_peered":"2022-09-17T10:27:42.415484+0000","last_unstale":"2022-09-17T10:27:46.877176+0000","last_undegraded":"2022-09-17T10:27:46.877176+0000","last_fullsized":"2022-09-17T10:27:46.877176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823651+0000","last_change":"2022-09-17T10:27:42.807756+0000","last_active":"2022-09-17T10:27:46.823651+0000","last_peered":"2022-09-17T10:27:46.823651+0000","last_clean":"2022-09-17T10:27:46.823651+0000","last_became_active":"2022-09-17T10:27:42.805782+0000","last_became_peered":"2022-09-17T10:27:42.805782+0000","last_unstale":"2022-09-17T10:27:46.823651+0000","last_undegraded":"2022-09-17T10:27:46.823651+0000","last_fullsized":"2022-09-17T10:27:46.823651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823055+0000","last_change":"2022-09-17T10:27:42.422195+0000","last_active":"2022-09-17T10:27:46.823055+0000","last_peered":"2022-09-17T10:27:46.823055+0000","last_clean":"2022-09-17T10:27:46.823055+0000","last_became_active":"2022-09-17T10:27:42.421922+0000","last_became_peered":"2022-09-17T10:27:42.421922+0000","last_unstale":"2022-09-17T10:27:46.823055+0000","last_undegraded":"2022-09-17T10:27:46.823055+0000","last_fullsized":"2022-09-17T10:27:46.823055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821862+0000","last_change":"2022-09-17T10:27:42.813050+0000","last_active":"2022-09-17T10:27:46.821862+0000","last_peered":"2022-09-17T10:27:46.821862+0000","last_clean":"2022-09-17T10:27:46.821862+0000","last_became_active":"2022-09-17T10:27:42.812770+0000","last_became_peered":"2022-09-17T10:27:42.812770+0000","last_unstale":"2022-09-17T10:27:46.821862+0000","last_undegraded":"2022-09-17T10:27:46.821862+0000","last_fullsized":"2022-09-17T10:27:46.821862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822857+0000","last_change":"2022-09-17T10:27:42.422344+0000","last_active":"2022-09-17T10:27:46.822857+0000","last_peered":"2022-09-17T10:27:46.822857+0000","last_clean":"2022-09-17T10:27:46.822857+0000","last_became_active":"2022-09-17T10:27:42.422015+0000","last_became_peered":"2022-09-17T10:27:42.422015+0000","last_unstale":"2022-09-17T10:27:46.822857+0000","last_undegraded":"2022-09-17T10:27:46.822857+0000","last_fullsized":"2022-09-17T10:27:46.822857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822890+0000","last_change":"2022-09-17T10:27:42.814260+0000","last_active":"2022-09-17T10:27:46.822890+0000","last_peered":"2022-09-17T10:27:46.822890+0000","last_clean":"2022-09-17T10:27:46.822890+0000","last_became_active":"2022-09-17T10:27:42.812936+0000","last_became_peered":"2022-09-17T10:27:42.812936+0000","last_unstale":"2022-09-17T10:27:46.822890+0000","last_undegraded":"2022-09-17T10:27:46.822890+0000","last_fullsized":"2022-09-17T10:27:46.822890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"26'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826690+0000","last_change":"2022-09-17T10:27:42.417825+0000","last_active":"2022-09-17T10:27:46.826690+0000","last_peered":"2022-09-17T10:27:46.826690+0000","last_clean":"2022-09-17T10:27:46.826690+0000","last_became_active":"2022-09-17T10:27:42.417512+0000","last_became_peered":"2022-09-17T10:27:42.417512+0000","last_unstale":"2022-09-17T10:27:46.826690+0000","last_undegraded":"2022-09-17T10:27:46.826690+0000","last_fullsized":"2022-09-17T10:27:46.826690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823543+0000","last_change":"2022-09-17T10:27:42.807539+0000","last_active":"2022-09-17T10:27:46.823543+0000","last_peered":"2022-09-17T10:27:46.823543+0000","last_clean":"2022-09-17T10:27:46.823543+0000","last_became_active":"2022-09-17T10:27:42.807279+0000","last_became_peered":"2022-09-17T10:27:42.807279+0000","last_unstale":"2022-09-17T10:27:46.823543+0000","last_undegraded":"2022-09-17T10:27:46.823543+0000","last_fullsized":"2022-09-17T10:27:46.823543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822418+0000","last_change":"2022-09-17T10:27:42.422307+0000","last_active":"2022-09-17T10:27:46.822418+0000","last_peered":"2022-09-17T10:27:46.822418+0000","last_clean":"2022-09-17T10:27:46.822418+0000","last_became_active":"2022-09-17T10:27:42.421975+0000","last_became_peered":"2022-09-17T10:27:42.421975+0000","last_unstale":"2022-09-17T10:27:46.822418+0000","last_undegraded":"2022-09-17T10:27:46.822418+0000","last_fullsized":"2022-09-17T10:27:46.822418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821707+0000","last_change":"2022-09-17T10:27:42.810271+0000","last_active":"2022-09-17T10:27:46.821707+0000","last_peered":"2022-09-17T10:27:46.821707+0000","last_clean":"2022-09-17T10:27:46.821707+0000","last_became_active":"2022-09-17T10:27:42.809991+0000","last_became_peered":"2022-09-17T10:27:42.809991+0000","last_unstale":"2022-09-17T10:27:46.821707+0000","last_undegraded":"2022-09-17T10:27:46.821707+0000","last_fullsized":"2022-09-17T10:27:46.821707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823546+0000","last_change":"2022-09-17T10:27:42.414343+0000","last_active":"2022-09-17T10:27:46.823546+0000","last_peered":"2022-09-17T10:27:46.823546+0000","last_clean":"2022-09-17T10:27:46.823546+0000","last_became_active":"2022-09-17T10:27:42.413935+0000","last_became_peered":"2022-09-17T10:27:42.413935+0000","last_unstale":"2022-09-17T10:27:46.823546+0000","last_undegraded":"2022-09-17T10:27:46.823546+0000","last_fullsized":"2022-09-17T10:27:46.823546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823831+0000","last_change":"2022-09-17T10:27:42.804945+0000","last_active":"2022-09-17T10:27:46.823831+0000","last_peered":"2022-09-17T10:27:46.823831+0000","last_clean":"2022-09-17T10:27:46.823831+0000","last_became_active":"2022-09-17T10:27:42.804661+0000","last_became_peered":"2022-09-17T10:27:42.804661+0000","last_unstale":"2022-09-17T10:27:46.823831+0000","last_undegraded":"2022-09-17T10:27:46.823831+0000","last_fullsized":"2022-09-17T10:27:46.823831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.278680+0000","last_change":"2022-09-17T10:27:42.423897+0000","last_active":"2022-09-17T10:27:47.278680+0000","last_peered":"2022-09-17T10:27:47.278680+0000","last_clean":"2022-09-17T10:27:47.278680+0000","last_became_active":"2022-09-17T10:27:42.423587+0000","last_became_peered":"2022-09-17T10:27:42.423587+0000","last_unstale":"2022-09-17T10:27:47.278680+0000","last_undegraded":"2022-09-17T10:27:47.278680+0000","last_fullsized":"2022-09-17T10:27:47.278680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821855+0000","last_change":"2022-09-17T10:27:42.814043+0000","last_active":"2022-09-17T10:27:46.821855+0000","last_peered":"2022-09-17T10:27:46.821855+0000","last_clean":"2022-09-17T10:27:46.821855+0000","last_became_active":"2022-09-17T10:27:42.813400+0000","last_became_peered":"2022-09-17T10:27:42.813400+0000","last_unstale":"2022-09-17T10:27:46.821855+0000","last_undegraded":"2022-09-17T10:27:46.821855+0000","last_fullsized":"2022-09-17T10:27:46.821855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821847+0000","last_change":"2022-09-17T10:27:42.420351+0000","last_active":"2022-09-17T10:27:46.821847+0000","last_peered":"2022-09-17T10:27:46.821847+0000","last_clean":"2022-09-17T10:27:46.821847+0000","last_became_active":"2022-09-17T10:27:42.420099+0000","last_became_peered":"2022-09-17T10:27:42.420099+0000","last_unstale":"2022-09-17T10:27:46.821847+0000","last_undegraded":"2022-09-17T10:27:46.821847+0000","last_fullsized":"2022-09-17T10:27:46.821847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823380+0000","last_change":"2022-09-17T10:27:42.809309+0000","last_active":"2022-09-17T10:27:46.823380+0000","last_peered":"2022-09-17T10:27:46.823380+0000","last_clean":"2022-09-17T10:27:46.823380+0000","last_became_active":"2022-09-17T10:27:42.809010+0000","last_became_peered":"2022-09-17T10:27:42.809010+0000","last_unstale":"2022-09-17T10:27:46.823380+0000","last_undegraded":"2022-09-17T10:27:46.823380+0000","last_fullsized":"2022-09-17T10:27:46.823380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877081+0000","last_change":"2022-09-17T10:27:42.420420+0000","last_active":"2022-09-17T10:27:46.877081+0000","last_peered":"2022-09-17T10:27:46.877081+0000","last_clean":"2022-09-17T10:27:46.877081+0000","last_became_active":"2022-09-17T10:27:42.420111+0000","last_became_peered":"2022-09-17T10:27:42.420111+0000","last_unstale":"2022-09-17T10:27:46.877081+0000","last_undegraded":"2022-09-17T10:27:46.877081+0000","last_fullsized":"2022-09-17T10:27:46.877081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828081+0000","last_change":"2022-09-17T10:27:42.813626+0000","last_active":"2022-09-17T10:27:46.828081+0000","last_peered":"2022-09-17T10:27:46.828081+0000","last_clean":"2022-09-17T10:27:46.828081+0000","last_became_active":"2022-09-17T10:27:42.813315+0000","last_became_peered":"2022-09-17T10:27:42.813315+0000","last_unstale":"2022-09-17T10:27:46.828081+0000","last_undegraded":"2022-09-17T10:27:46.828081+0000","last_fullsized":"2022-09-17T10:27:46.828081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828974+0000","last_change":"2022-09-17T10:27:42.418323+0000","last_active":"2022-09-17T10:27:46.828974+0000","last_peered":"2022-09-17T10:27:46.828974+0000","last_clean":"2022-09-17T10:27:46.828974+0000","last_became_active":"2022-09-17T10:27:42.417741+0000","last_became_peered":"2022-09-17T10:27:42.417741+0000","last_unstale":"2022-09-17T10:27:46.828974+0000","last_undegraded":"2022-09-17T10:27:46.828974+0000","last_fullsized":"2022-09-17T10:27:46.828974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877907+0000","last_change":"2022-09-17T10:27:42.815309+0000","last_active":"2022-09-17T10:27:46.877907+0000","last_peered":"2022-09-17T10:27:46.877907+0000","last_clean":"2022-09-17T10:27:46.877907+0000","last_became_active":"2022-09-17T10:27:42.815017+0000","last_became_peered":"2022-09-17T10:27:42.815017+0000","last_unstale":"2022-09-17T10:27:46.877907+0000","last_undegraded":"2022-09-17T10:27:46.877907+0000","last_fullsized":"2022-09-17T10:27:46.877907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831220+0000","last_change":"2022-09-17T10:27:42.426225+0000","last_active":"2022-09-17T10:27:46.831220+0000","last_peered":"2022-09-17T10:27:46.831220+0000","last_clean":"2022-09-17T10:27:46.831220+0000","last_became_active":"2022-09-17T10:27:42.425653+0000","last_became_peered":"2022-09-17T10:27:42.425653+0000","last_unstale":"2022-09-17T10:27:46.831220+0000","last_undegraded":"2022-09-17T10:27:46.831220+0000","last_fullsized":"2022-09-17T10:27:46.831220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823944+0000","last_change":"2022-09-17T10:27:42.811093+0000","last_active":"2022-09-17T10:27:46.823944+0000","last_peered":"2022-09-17T10:27:46.823944+0000","last_clean":"2022-09-17T10:27:46.823944+0000","last_became_active":"2022-09-17T10:27:42.810788+0000","last_became_peered":"2022-09-17T10:27:42.810788+0000","last_unstale":"2022-09-17T10:27:46.823944+0000","last_undegraded":"2022-09-17T10:27:46.823944+0000","last_fullsized":"2022-09-17T10:27:46.823944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826854+0000","last_change":"2022-09-17T10:27:42.418052+0000","last_active":"2022-09-17T10:27:46.826854+0000","last_peered":"2022-09-17T10:27:46.826854+0000","last_clean":"2022-09-17T10:27:46.826854+0000","last_became_active":"2022-09-17T10:27:42.417695+0000","last_became_peered":"2022-09-17T10:27:42.417695+0000","last_unstale":"2022-09-17T10:27:46.826854+0000","last_undegraded":"2022-09-17T10:27:46.826854+0000","last_fullsized":"2022-09-17T10:27:46.826854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823676+0000","last_change":"2022-09-17T10:27:42.816896+0000","last_active":"2022-09-17T10:27:46.823676+0000","last_peered":"2022-09-17T10:27:46.823676+0000","last_clean":"2022-09-17T10:27:46.823676+0000","last_became_active":"2022-09-17T10:27:42.816607+0000","last_became_peered":"2022-09-17T10:27:42.816607+0000","last_unstale":"2022-09-17T10:27:46.823676+0000","last_undegraded":"2022-09-17T10:27:46.823676+0000","last_fullsized":"2022-09-17T10:27:46.823676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831328+0000","last_change":"2022-09-17T10:27:42.421839+0000","last_active":"2022-09-17T10:27:46.831328+0000","last_peered":"2022-09-17T10:27:46.831328+0000","last_clean":"2022-09-17T10:27:46.831328+0000","last_became_active":"2022-09-17T10:27:42.421558+0000","last_became_peered":"2022-09-17T10:27:42.421558+0000","last_unstale":"2022-09-17T10:27:46.831328+0000","last_undegraded":"2022-09-17T10:27:46.831328+0000","last_fullsized":"2022-09-17T10:27:46.831328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822971+0000","last_change":"2022-09-17T10:27:42.812667+0000","last_active":"2022-09-17T10:27:46.822971+0000","last_peered":"2022-09-17T10:27:46.822971+0000","last_clean":"2022-09-17T10:27:46.822971+0000","last_became_active":"2022-09-17T10:27:42.812360+0000","last_became_peered":"2022-09-17T10:27:42.812360+0000","last_unstale":"2022-09-17T10:27:46.822971+0000","last_undegraded":"2022-09-17T10:27:46.822971+0000","last_fullsized":"2022-09-17T10:27:46.822971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.278681+0000","last_change":"2022-09-17T10:27:42.418422+0000","last_active":"2022-09-17T10:27:47.278681+0000","last_peered":"2022-09-17T10:27:47.278681+0000","last_clean":"2022-09-17T10:27:47.278681+0000","last_became_active":"2022-09-17T10:27:42.418158+0000","last_became_peered":"2022-09-17T10:27:42.418158+0000","last_unstale":"2022-09-17T10:27:47.278681+0000","last_undegraded":"2022-09-17T10:27:47.278681+0000","last_fullsized":"2022-09-17T10:27:47.278681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876897+0000","last_change":"2022-09-17T10:27:42.816353+0000","last_active":"2022-09-17T10:27:46.876897+0000","last_peered":"2022-09-17T10:27:46.876897+0000","last_clean":"2022-09-17T10:27:46.876897+0000","last_became_active":"2022-09-17T10:27:42.816143+0000","last_became_peered":"2022-09-17T10:27:42.816143+0000","last_unstale":"2022-09-17T10:27:46.876897+0000","last_undegraded":"2022-09-17T10:27:46.876897+0000","last_fullsized":"2022-09-17T10:27:46.876897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822690+0000","last_change":"2022-09-17T10:27:42.415503+0000","last_active":"2022-09-17T10:27:46.822690+0000","last_peered":"2022-09-17T10:27:46.822690+0000","last_clean":"2022-09-17T10:27:46.822690+0000","last_became_active":"2022-09-17T10:27:42.415203+0000","last_became_peered":"2022-09-17T10:27:42.415203+0000","last_unstale":"2022-09-17T10:27:46.822690+0000","last_undegraded":"2022-09-17T10:27:46.822690+0000","last_fullsized":"2022-09-17T10:27:46.822690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821740+0000","last_change":"2022-09-17T10:27:42.814233+0000","last_active":"2022-09-17T10:27:46.821740+0000","last_peered":"2022-09-17T10:27:46.821740+0000","last_clean":"2022-09-17T10:27:46.821740+0000","last_became_active":"2022-09-17T10:27:42.813735+0000","last_became_peered":"2022-09-17T10:27:42.813735+0000","last_unstale":"2022-09-17T10:27:46.821740+0000","last_undegraded":"2022-09-17T10:27:46.821740+0000","last_fullsized":"2022-09-17T10:27:46.821740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877411+0000","last_change":"2022-09-17T10:27:42.420755+0000","last_active":"2022-09-17T10:27:46.877411+0000","last_peered":"2022-09-17T10:27:46.877411+0000","last_clean":"2022-09-17T10:27:46.877411+0000","last_became_active":"2022-09-17T10:27:42.420413+0000","last_became_peered":"2022-09-17T10:27:42.420413+0000","last_unstale":"2022-09-17T10:27:46.877411+0000","last_undegraded":"2022-09-17T10:27:46.877411+0000","last_fullsized":"2022-09-17T10:27:46.877411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831001+0000","last_change":"2022-09-17T10:27:42.818083+0000","last_active":"2022-09-17T10:27:46.831001+0000","last_peered":"2022-09-17T10:27:46.831001+0000","last_clean":"2022-09-17T10:27:46.831001+0000","last_became_active":"2022-09-17T10:27:42.817877+0000","last_became_peered":"2022-09-17T10:27:42.817877+0000","last_unstale":"2022-09-17T10:27:46.831001+0000","last_undegraded":"2022-09-17T10:27:46.831001+0000","last_fullsized":"2022-09-17T10:27:46.831001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824985+0000","last_change":"2022-09-17T10:27:42.419616+0000","last_active":"2022-09-17T10:27:46.824985+0000","last_peered":"2022-09-17T10:27:46.824985+0000","last_clean":"2022-09-17T10:27:46.824985+0000","last_became_active":"2022-09-17T10:27:42.419310+0000","last_became_peered":"2022-09-17T10:27:42.419310+0000","last_unstale":"2022-09-17T10:27:46.824985+0000","last_undegraded":"2022-09-17T10:27:46.824985+0000","last_fullsized":"2022-09-17T10:27:46.824985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825681+0000","last_change":"2022-09-17T10:27:42.817667+0000","last_active":"2022-09-17T10:27:46.825681+0000","last_peered":"2022-09-17T10:27:46.825681+0000","last_clean":"2022-09-17T10:27:46.825681+0000","last_became_active":"2022-09-17T10:27:42.817320+0000","last_became_peered":"2022-09-17T10:27:42.817320+0000","last_unstale":"2022-09-17T10:27:46.825681+0000","last_undegraded":"2022-09-17T10:27:46.825681+0000","last_fullsized":"2022-09-17T10:27:46.825681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824135+0000","last_change":"2022-09-17T10:27:42.423348+0000","last_active":"2022-09-17T10:27:46.824135+0000","last_peered":"2022-09-17T10:27:46.824135+0000","last_clean":"2022-09-17T10:27:46.824135+0000","last_became_active":"2022-09-17T10:27:42.423040+0000","last_became_peered":"2022-09-17T10:27:42.423040+0000","last_unstale":"2022-09-17T10:27:46.824135+0000","last_undegraded":"2022-09-17T10:27:46.824135+0000","last_fullsized":"2022-09-17T10:27:46.824135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822997+0000","last_change":"2022-09-17T10:27:42.808072+0000","last_active":"2022-09-17T10:27:46.822997+0000","last_peered":"2022-09-17T10:27:46.822997+0000","last_clean":"2022-09-17T10:27:46.822997+0000","last_became_active":"2022-09-17T10:27:42.807765+0000","last_became_peered":"2022-09-17T10:27:42.807765+0000","last_unstale":"2022-09-17T10:27:46.822997+0000","last_undegraded":"2022-09-17T10:27:46.822997+0000","last_fullsized":"2022-09-17T10:27:46.822997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823608+0000","last_change":"2022-09-17T10:27:42.417146+0000","last_active":"2022-09-17T10:27:46.823608+0000","last_peered":"2022-09-17T10:27:46.823608+0000","last_clean":"2022-09-17T10:27:46.823608+0000","last_became_active":"2022-09-17T10:27:42.416444+0000","last_became_peered":"2022-09-17T10:27:42.416444+0000","last_unstale":"2022-09-17T10:27:46.823608+0000","last_undegraded":"2022-09-17T10:27:46.823608+0000","last_fullsized":"2022-09-17T10:27:46.823608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879652+0000","last_change":"2022-09-17T10:27:42.808199+0000","last_active":"2022-09-17T10:27:46.879652+0000","last_peered":"2022-09-17T10:27:46.879652+0000","last_clean":"2022-09-17T10:27:46.879652+0000","last_became_active":"2022-09-17T10:27:42.807904+0000","last_became_peered":"2022-09-17T10:27:42.807904+0000","last_unstale":"2022-09-17T10:27:46.879652+0000","last_undegraded":"2022-09-17T10:27:46.879652+0000","last_fullsized":"2022-09-17T10:27:46.879652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821818+0000","last_change":"2022-09-17T10:27:42.419293+0000","last_active":"2022-09-17T10:27:46.821818+0000","last_peered":"2022-09-17T10:27:46.821818+0000","last_clean":"2022-09-17T10:27:46.821818+0000","last_became_active":"2022-09-17T10:27:42.419016+0000","last_became_peered":"2022-09-17T10:27:42.419016+0000","last_unstale":"2022-09-17T10:27:46.821818+0000","last_undegraded":"2022-09-17T10:27:46.821818+0000","last_fullsized":"2022-09-17T10:27:46.821818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823777+0000","last_change":"2022-09-17T10:27:42.811222+0000","last_active":"2022-09-17T10:27:46.823777+0000","last_peered":"2022-09-17T10:27:46.823777+0000","last_clean":"2022-09-17T10:27:46.823777+0000","last_became_active":"2022-09-17T10:27:42.810431+0000","last_became_peered":"2022-09-17T10:27:42.810431+0000","last_unstale":"2022-09-17T10:27:46.823777+0000","last_undegraded":"2022-09-17T10:27:46.823777+0000","last_fullsized":"2022-09-17T10:27:46.823777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"26'1","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824396+0000","last_change":"2022-09-17T10:27:42.418764+0000","last_active":"2022-09-17T10:27:46.824396+0000","last_peered":"2022-09-17T10:27:46.824396+0000","last_clean":"2022-09-17T10:27:46.824396+0000","last_became_active":"2022-09-17T10:27:42.418460+0000","last_became_peered":"2022-09-17T10:27:42.418460+0000","last_unstale":"2022-09-17T10:27:46.824396+0000","last_undegraded":"2022-09-17T10:27:46.824396+0000","last_fullsized":"2022-09-17T10:27:46.824396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820837+0000","last_change":"2022-09-17T10:27:42.811297+0000","last_active":"2022-09-17T10:27:46.820837+0000","last_peered":"2022-09-17T10:27:46.820837+0000","last_clean":"2022-09-17T10:27:46.820837+0000","last_became_active":"2022-09-17T10:27:42.810563+0000","last_became_peered":"2022-09-17T10:27:42.810563+0000","last_unstale":"2022-09-17T10:27:46.820837+0000","last_undegraded":"2022-09-17T10:27:46.820837+0000","last_fullsized":"2022-09-17T10:27:46.820837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.881583+0000","last_change":"2022-09-17T10:27:46.879898+0000","last_active":"2022-09-17T10:27:46.881583+0000","last_peered":"2022-09-17T10:27:46.881583+0000","last_clean":"2022-09-17T10:27:46.881583+0000","last_became_active":"2022-09-17T10:27:46.877842+0000","last_became_peered":"2022-09-17T10:27:46.877842+0000","last_unstale":"2022-09-17T10:27:46.881583+0000","last_undegraded":"2022-09-17T10:27:46.881583+0000","last_fullsized":"2022-09-17T10:27:46.881583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831170+0000","last_change":"2022-09-17T10:27:42.426206+0000","last_active":"2022-09-17T10:27:46.831170+0000","last_peered":"2022-09-17T10:27:46.831170+0000","last_clean":"2022-09-17T10:27:46.831170+0000","last_became_active":"2022-09-17T10:27:42.425534+0000","last_became_peered":"2022-09-17T10:27:42.425534+0000","last_unstale":"2022-09-17T10:27:46.831170+0000","last_undegraded":"2022-09-17T10:27:46.831170+0000","last_fullsized":"2022-09-17T10:27:46.831170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823594+0000","last_change":"2022-09-17T10:27:42.805131+0000","last_active":"2022-09-17T10:27:46.823594+0000","last_peered":"2022-09-17T10:27:46.823594+0000","last_clean":"2022-09-17T10:27:46.823594+0000","last_became_active":"2022-09-17T10:27:42.804846+0000","last_became_peered":"2022-09-17T10:27:42.804846+0000","last_unstale":"2022-09-17T10:27:46.823594+0000","last_undegraded":"2022-09-17T10:27:46.823594+0000","last_fullsized":"2022-09-17T10:27:46.823594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838709+0000","last_change":"2022-09-17T10:27:46.833771+0000","last_active":"2022-09-17T10:27:46.838709+0000","last_peered":"2022-09-17T10:27:46.838709+0000","last_clean":"2022-09-17T10:27:46.838709+0000","last_became_active":"2022-09-17T10:27:46.833345+0000","last_became_peered":"2022-09-17T10:27:46.833345+0000","last_unstale":"2022-09-17T10:27:46.838709+0000","last_undegraded":"2022-09-17T10:27:46.838709+0000","last_fullsized":"2022-09-17T10:27:46.838709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826554+0000","last_change":"2022-09-17T10:27:42.422308+0000","last_active":"2022-09-17T10:27:46.826554+0000","last_peered":"2022-09-17T10:27:46.826554+0000","last_clean":"2022-09-17T10:27:46.826554+0000","last_became_active":"2022-09-17T10:27:42.422019+0000","last_became_peered":"2022-09-17T10:27:42.422019+0000","last_unstale":"2022-09-17T10:27:46.826554+0000","last_undegraded":"2022-09-17T10:27:46.826554+0000","last_fullsized":"2022-09-17T10:27:46.826554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821083+0000","last_change":"2022-09-17T10:27:42.810397+0000","last_active":"2022-09-17T10:27:46.821083+0000","last_peered":"2022-09-17T10:27:46.821083+0000","last_clean":"2022-09-17T10:27:46.821083+0000","last_became_active":"2022-09-17T10:27:42.810076+0000","last_became_peered":"2022-09-17T10:27:42.810076+0000","last_unstale":"2022-09-17T10:27:46.821083+0000","last_undegraded":"2022-09-17T10:27:46.821083+0000","last_fullsized":"2022-09-17T10:27:46.821083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839292+0000","last_change":"2022-09-17T10:27:46.836157+0000","last_active":"2022-09-17T10:27:46.839292+0000","last_peered":"2022-09-17T10:27:46.839292+0000","last_clean":"2022-09-17T10:27:46.839292+0000","last_became_active":"2022-09-17T10:27:46.835717+0000","last_became_peered":"2022-09-17T10:27:46.835717+0000","last_unstale":"2022-09-17T10:27:46.839292+0000","last_undegraded":"2022-09-17T10:27:46.839292+0000","last_fullsized":"2022-09-17T10:27:46.839292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827850+0000","last_change":"2022-09-17T10:27:42.414705+0000","last_active":"2022-09-17T10:27:46.827850+0000","last_peered":"2022-09-17T10:27:46.827850+0000","last_clean":"2022-09-17T10:27:46.827850+0000","last_became_active":"2022-09-17T10:27:42.414385+0000","last_became_peered":"2022-09-17T10:27:42.414385+0000","last_unstale":"2022-09-17T10:27:46.827850+0000","last_undegraded":"2022-09-17T10:27:46.827850+0000","last_fullsized":"2022-09-17T10:27:46.827850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820968+0000","last_change":"2022-09-17T10:27:42.817114+0000","last_active":"2022-09-17T10:27:46.820968+0000","last_peered":"2022-09-17T10:27:46.820968+0000","last_clean":"2022-09-17T10:27:46.820968+0000","last_became_active":"2022-09-17T10:27:42.816803+0000","last_became_peered":"2022-09-17T10:27:42.816803+0000","last_unstale":"2022-09-17T10:27:46.820968+0000","last_undegraded":"2022-09-17T10:27:46.820968+0000","last_fullsized":"2022-09-17T10:27:46.820968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879975+0000","last_change":"2022-09-17T10:27:46.878852+0000","last_active":"2022-09-17T10:27:46.879975+0000","last_peered":"2022-09-17T10:27:46.879975+0000","last_clean":"2022-09-17T10:27:46.879975+0000","last_became_active":"2022-09-17T10:27:46.878402+0000","last_became_peered":"2022-09-17T10:27:46.878402+0000","last_unstale":"2022-09-17T10:27:46.879975+0000","last_undegraded":"2022-09-17T10:27:46.879975+0000","last_fullsized":"2022-09-17T10:27:46.879975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.882394+0000","last_change":"2022-09-17T10:27:46.880930+0000","last_active":"2022-09-17T10:27:46.882394+0000","last_peered":"2022-09-17T10:27:46.882394+0000","last_clean":"2022-09-17T10:27:46.882394+0000","last_became_active":"2022-09-17T10:27:46.880498+0000","last_became_peered":"2022-09-17T10:27:46.880498+0000","last_unstale":"2022-09-17T10:27:46.882394+0000","last_undegraded":"2022-09-17T10:27:46.882394+0000","last_fullsized":"2022-09-17T10:27:46.882394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828368+0000","last_change":"2022-09-17T10:27:42.422458+0000","last_active":"2022-09-17T10:27:46.828368+0000","last_peered":"2022-09-17T10:27:46.828368+0000","last_clean":"2022-09-17T10:27:46.828368+0000","last_became_active":"2022-09-17T10:27:42.422187+0000","last_became_peered":"2022-09-17T10:27:42.422187+0000","last_unstale":"2022-09-17T10:27:46.828368+0000","last_undegraded":"2022-09-17T10:27:46.828368+0000","last_fullsized":"2022-09-17T10:27:46.828368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825686+0000","last_change":"2022-09-17T10:27:42.806970+0000","last_active":"2022-09-17T10:27:46.825686+0000","last_peered":"2022-09-17T10:27:46.825686+0000","last_clean":"2022-09-17T10:27:46.825686+0000","last_became_active":"2022-09-17T10:27:42.806322+0000","last_became_peered":"2022-09-17T10:27:42.806322+0000","last_unstale":"2022-09-17T10:27:46.825686+0000","last_undegraded":"2022-09-17T10:27:46.825686+0000","last_fullsized":"2022-09-17T10:27:46.825686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823713+0000","last_change":"2022-09-17T10:27:42.812236+0000","last_active":"2022-09-17T10:27:46.823713+0000","last_peered":"2022-09-17T10:27:46.823713+0000","last_clean":"2022-09-17T10:27:46.823713+0000","last_became_active":"2022-09-17T10:27:42.811869+0000","last_became_peered":"2022-09-17T10:27:42.811869+0000","last_unstale":"2022-09-17T10:27:46.823713+0000","last_undegraded":"2022-09-17T10:27:46.823713+0000","last_fullsized":"2022-09-17T10:27:46.823713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823142+0000","last_change":"2022-09-17T10:27:42.423679+0000","last_active":"2022-09-17T10:27:46.823142+0000","last_peered":"2022-09-17T10:27:46.823142+0000","last_clean":"2022-09-17T10:27:46.823142+0000","last_became_active":"2022-09-17T10:27:42.423382+0000","last_became_peered":"2022-09-17T10:27:42.423382+0000","last_unstale":"2022-09-17T10:27:46.823142+0000","last_undegraded":"2022-09-17T10:27:46.823142+0000","last_fullsized":"2022-09-17T10:27:46.823142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821044+0000","last_change":"2022-09-17T10:27:37.393333+0000","last_active":"2022-09-17T10:27:46.821044+0000","last_peered":"2022-09-17T10:27:46.821044+0000","last_clean":"2022-09-17T10:27:46.821044+0000","last_became_active":"2022-09-17T10:27:37.393020+0000","last_became_peered":"2022-09-17T10:27:37.393020+0000","last_unstale":"2022-09-17T10:27:46.821044+0000","last_undegraded":"2022-09-17T10:27:46.821044+0000","last_fullsized":"2022-09-17T10:27:46.821044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.836043+0000","last_change":"2022-09-17T10:27:46.833138+0000","last_active":"2022-09-17T10:27:46.836043+0000","last_peered":"2022-09-17T10:27:46.836043+0000","last_clean":"2022-09-17T10:27:46.836043+0000","last_became_active":"2022-09-17T10:27:46.832732+0000","last_became_peered":"2022-09-17T10:27:46.832732+0000","last_unstale":"2022-09-17T10:27:46.836043+0000","last_undegraded":"2022-09-17T10:27:46.836043+0000","last_fullsized":"2022-09-17T10:27:46.836043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830521+0000","last_change":"2022-09-17T10:27:42.808357+0000","last_active":"2022-09-17T10:27:46.830521+0000","last_peered":"2022-09-17T10:27:46.830521+0000","last_clean":"2022-09-17T10:27:46.830521+0000","last_became_active":"2022-09-17T10:27:42.808087+0000","last_became_peered":"2022-09-17T10:27:42.808087+0000","last_unstale":"2022-09-17T10:27:46.830521+0000","last_undegraded":"2022-09-17T10:27:46.830521+0000","last_fullsized":"2022-09-17T10:27:46.830521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823635+0000","last_change":"2022-09-17T10:27:37.394630+0000","last_active":"2022-09-17T10:27:46.823635+0000","last_peered":"2022-09-17T10:27:46.823635+0000","last_clean":"2022-09-17T10:27:46.823635+0000","last_became_active":"2022-09-17T10:27:37.394313+0000","last_became_peered":"2022-09-17T10:27:37.394313+0000","last_unstale":"2022-09-17T10:27:46.823635+0000","last_undegraded":"2022-09-17T10:27:46.823635+0000","last_fullsized":"2022-09-17T10:27:46.823635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831821+0000","last_change":"2022-09-17T10:27:42.423502+0000","last_active":"2022-09-17T10:27:46.831821+0000","last_peered":"2022-09-17T10:27:46.831821+0000","last_clean":"2022-09-17T10:27:46.831821+0000","last_became_active":"2022-09-17T10:27:42.423217+0000","last_became_peered":"2022-09-17T10:27:42.423217+0000","last_unstale":"2022-09-17T10:27:46.831821+0000","last_undegraded":"2022-09-17T10:27:46.831821+0000","last_fullsized":"2022-09-17T10:27:46.831821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839878+0000","last_change":"2022-09-17T10:27:46.837673+0000","last_active":"2022-09-17T10:27:46.839878+0000","last_peered":"2022-09-17T10:27:46.839878+0000","last_clean":"2022-09-17T10:27:46.839878+0000","last_became_active":"2022-09-17T10:27:46.837297+0000","last_became_peered":"2022-09-17T10:27:46.837297+0000","last_unstale":"2022-09-17T10:27:46.839878+0000","last_undegraded":"2022-09-17T10:27:46.839878+0000","last_fullsized":"2022-09-17T10:27:46.839878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821835+0000","last_change":"2022-09-17T10:27:42.817158+0000","last_active":"2022-09-17T10:27:46.821835+0000","last_peered":"2022-09-17T10:27:46.821835+0000","last_clean":"2022-09-17T10:27:46.821835+0000","last_became_active":"2022-09-17T10:27:42.816865+0000","last_became_peered":"2022-09-17T10:27:42.816865+0000","last_unstale":"2022-09-17T10:27:46.821835+0000","last_undegraded":"2022-09-17T10:27:46.821835+0000","last_fullsized":"2022-09-17T10:27:46.821835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877323+0000","last_change":"2022-09-17T10:27:42.420110+0000","last_active":"2022-09-17T10:27:46.877323+0000","last_peered":"2022-09-17T10:27:46.877323+0000","last_clean":"2022-09-17T10:27:46.877323+0000","last_became_active":"2022-09-17T10:27:42.419792+0000","last_became_peered":"2022-09-17T10:27:42.419792+0000","last_unstale":"2022-09-17T10:27:46.877323+0000","last_undegraded":"2022-09-17T10:27:46.877323+0000","last_fullsized":"2022-09-17T10:27:46.877323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832869+0000","last_change":"2022-09-17T10:27:37.518568+0000","last_active":"2022-09-17T10:27:46.832869+0000","last_peered":"2022-09-17T10:27:46.832869+0000","last_clean":"2022-09-17T10:27:46.832869+0000","last_became_active":"2022-09-17T10:27:37.518118+0000","last_became_peered":"2022-09-17T10:27:37.518118+0000","last_unstale":"2022-09-17T10:27:46.832869+0000","last_undegraded":"2022-09-17T10:27:46.832869+0000","last_fullsized":"2022-09-17T10:27:46.832869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.834941+0000","last_change":"2022-09-17T10:27:46.830735+0000","last_active":"2022-09-17T10:27:46.834941+0000","last_peered":"2022-09-17T10:27:46.834941+0000","last_clean":"2022-09-17T10:27:46.834941+0000","last_became_active":"2022-09-17T10:27:46.830221+0000","last_became_peered":"2022-09-17T10:27:46.830221+0000","last_unstale":"2022-09-17T10:27:46.834941+0000","last_undegraded":"2022-09-17T10:27:46.834941+0000","last_fullsized":"2022-09-17T10:27:46.834941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876839+0000","last_change":"2022-09-17T10:27:42.417099+0000","last_active":"2022-09-17T10:27:46.876839+0000","last_peered":"2022-09-17T10:27:46.876839+0000","last_clean":"2022-09-17T10:27:46.876839+0000","last_became_active":"2022-09-17T10:27:42.416817+0000","last_became_peered":"2022-09-17T10:27:42.416817+0000","last_unstale":"2022-09-17T10:27:46.876839+0000","last_undegraded":"2022-09-17T10:27:46.876839+0000","last_fullsized":"2022-09-17T10:27:46.876839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831235+0000","last_change":"2022-09-17T10:27:37.519776+0000","last_active":"2022-09-17T10:27:46.831235+0000","last_peered":"2022-09-17T10:27:46.831235+0000","last_clean":"2022-09-17T10:27:46.831235+0000","last_became_active":"2022-09-17T10:27:37.519419+0000","last_became_peered":"2022-09-17T10:27:37.519419+0000","last_unstale":"2022-09-17T10:27:46.831235+0000","last_undegraded":"2022-09-17T10:27:46.831235+0000","last_fullsized":"2022-09-17T10:27:46.831235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826040+0000","last_change":"2022-09-17T10:27:42.818131+0000","last_active":"2022-09-17T10:27:46.826040+0000","last_peered":"2022-09-17T10:27:46.826040+0000","last_clean":"2022-09-17T10:27:46.826040+0000","last_became_active":"2022-09-17T10:27:42.817852+0000","last_became_peered":"2022-09-17T10:27:42.817852+0000","last_unstale":"2022-09-17T10:27:46.826040+0000","last_undegraded":"2022-09-17T10:27:46.826040+0000","last_fullsized":"2022-09-17T10:27:46.826040+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838321+0000","last_change":"2022-09-17T10:27:46.836570+0000","last_active":"2022-09-17T10:27:46.838321+0000","last_peered":"2022-09-17T10:27:46.838321+0000","last_clean":"2022-09-17T10:27:46.838321+0000","last_became_active":"2022-09-17T10:27:46.836058+0000","last_became_peered":"2022-09-17T10:27:46.836058+0000","last_unstale":"2022-09-17T10:27:46.838321+0000","last_undegraded":"2022-09-17T10:27:46.838321+0000","last_fullsized":"2022-09-17T10:27:46.838321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831209+0000","last_change":"2022-09-17T10:27:42.421065+0000","last_active":"2022-09-17T10:27:46.831209+0000","last_peered":"2022-09-17T10:27:46.831209+0000","last_clean":"2022-09-17T10:27:46.831209+0000","last_became_active":"2022-09-17T10:27:42.420726+0000","last_became_peered":"2022-09-17T10:27:42.420726+0000","last_unstale":"2022-09-17T10:27:46.831209+0000","last_undegraded":"2022-09-17T10:27:46.831209+0000","last_fullsized":"2022-09-17T10:27:46.831209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826418+0000","last_change":"2022-09-17T10:27:34.683645+0000","last_active":"2022-09-17T10:27:46.826418+0000","last_peered":"2022-09-17T10:27:46.826418+0000","last_clean":"2022-09-17T10:27:46.826418+0000","last_became_active":"2022-09-17T10:27:34.683343+0000","last_became_peered":"2022-09-17T10:27:34.683343+0000","last_unstale":"2022-09-17T10:27:46.826418+0000","last_undegraded":"2022-09-17T10:27:46.826418+0000","last_fullsized":"2022-09-17T10:27:46.826418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:33.351685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:33.351685+0000","last_clean_scrub_stamp":"2022-09-17T10:27:33.351685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820922+0000","last_change":"2022-09-17T10:27:37.392686+0000","last_active":"2022-09-17T10:27:46.820922+0000","last_peered":"2022-09-17T10:27:46.820922+0000","last_clean":"2022-09-17T10:27:46.820922+0000","last_became_active":"2022-09-17T10:27:37.392465+0000","last_became_peered":"2022-09-17T10:27:37.392465+0000","last_unstale":"2022-09-17T10:27:46.820922+0000","last_undegraded":"2022-09-17T10:27:46.820922+0000","last_fullsized":"2022-09-17T10:27:46.820922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828213+0000","last_change":"2022-09-17T10:27:42.817727+0000","last_active":"2022-09-17T10:27:46.828213+0000","last_peered":"2022-09-17T10:27:46.828213+0000","last_clean":"2022-09-17T10:27:46.828213+0000","last_became_active":"2022-09-17T10:27:42.817394+0000","last_became_peered":"2022-09-17T10:27:42.817394+0000","last_unstale":"2022-09-17T10:27:46.828213+0000","last_undegraded":"2022-09-17T10:27:46.828213+0000","last_fullsized":"2022-09-17T10:27:46.828213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879456+0000","last_change":"2022-09-17T10:27:46.878670+0000","last_active":"2022-09-17T10:27:46.879456+0000","last_peered":"2022-09-17T10:27:46.879456+0000","last_clean":"2022-09-17T10:27:46.879456+0000","last_became_active":"2022-09-17T10:27:46.878229+0000","last_became_peered":"2022-09-17T10:27:46.878229+0000","last_unstale":"2022-09-17T10:27:46.879456+0000","last_undegraded":"2022-09-17T10:27:46.879456+0000","last_fullsized":"2022-09-17T10:27:46.879456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826285+0000","last_change":"2022-09-17T10:27:42.419675+0000","last_active":"2022-09-17T10:27:46.826285+0000","last_peered":"2022-09-17T10:27:46.826285+0000","last_clean":"2022-09-17T10:27:46.826285+0000","last_became_active":"2022-09-17T10:27:42.419276+0000","last_became_peered":"2022-09-17T10:27:42.419276+0000","last_unstale":"2022-09-17T10:27:46.826285+0000","last_undegraded":"2022-09-17T10:27:46.826285+0000","last_fullsized":"2022-09-17T10:27:46.826285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876695+0000","last_change":"2022-09-17T10:27:37.518223+0000","last_active":"2022-09-17T10:27:46.876695+0000","last_peered":"2022-09-17T10:27:46.876695+0000","last_clean":"2022-09-17T10:27:46.876695+0000","last_became_active":"2022-09-17T10:27:37.517883+0000","last_became_peered":"2022-09-17T10:27:37.517883+0000","last_unstale":"2022-09-17T10:27:46.876695+0000","last_undegraded":"2022-09-17T10:27:46.876695+0000","last_fullsized":"2022-09-17T10:27:46.876695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.878284+0000","last_change":"2022-09-17T10:27:42.817484+0000","last_active":"2022-09-17T10:27:46.878284+0000","last_peered":"2022-09-17T10:27:46.878284+0000","last_clean":"2022-09-17T10:27:46.878284+0000","last_became_active":"2022-09-17T10:27:42.817192+0000","last_became_peered":"2022-09-17T10:27:42.817192+0000","last_unstale":"2022-09-17T10:27:46.878284+0000","last_undegraded":"2022-09-17T10:27:46.878284+0000","last_fullsized":"2022-09-17T10:27:46.878284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879275+0000","last_change":"2022-09-17T10:27:46.878284+0000","last_active":"2022-09-17T10:27:46.879275+0000","last_peered":"2022-09-17T10:27:46.879275+0000","last_clean":"2022-09-17T10:27:46.879275+0000","last_became_active":"2022-09-17T10:27:46.877826+0000","last_became_peered":"2022-09-17T10:27:46.877826+0000","last_unstale":"2022-09-17T10:27:46.879275+0000","last_undegraded":"2022-09-17T10:27:46.879275+0000","last_fullsized":"2022-09-17T10:27:46.879275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877241+0000","last_change":"2022-09-17T10:27:42.805395+0000","last_active":"2022-09-17T10:27:46.877241+0000","last_peered":"2022-09-17T10:27:46.877241+0000","last_clean":"2022-09-17T10:27:46.877241+0000","last_became_active":"2022-09-17T10:27:42.805072+0000","last_became_peered":"2022-09-17T10:27:42.805072+0000","last_unstale":"2022-09-17T10:27:46.877241+0000","last_undegraded":"2022-09-17T10:27:46.877241+0000","last_fullsized":"2022-09-17T10:27:46.877241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823138+0000","last_change":"2022-09-17T10:27:42.422220+0000","last_active":"2022-09-17T10:27:46.823138+0000","last_peered":"2022-09-17T10:27:46.823138+0000","last_clean":"2022-09-17T10:27:46.823138+0000","last_became_active":"2022-09-17T10:27:42.421941+0000","last_became_peered":"2022-09-17T10:27:42.421941+0000","last_unstale":"2022-09-17T10:27:46.823138+0000","last_undegraded":"2022-09-17T10:27:46.823138+0000","last_fullsized":"2022-09-17T10:27:46.823138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827201+0000","last_change":"2022-09-17T10:27:37.394582+0000","last_active":"2022-09-17T10:27:46.827201+0000","last_peered":"2022-09-17T10:27:46.827201+0000","last_clean":"2022-09-17T10:27:46.827201+0000","last_became_active":"2022-09-17T10:27:37.394285+0000","last_became_peered":"2022-09-17T10:27:37.394285+0000","last_unstale":"2022-09-17T10:27:46.827201+0000","last_undegraded":"2022-09-17T10:27:46.827201+0000","last_fullsized":"2022-09-17T10:27:46.827201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.881600+0000","last_change":"2022-09-17T10:27:46.880385+0000","last_active":"2022-09-17T10:27:46.881600+0000","last_peered":"2022-09-17T10:27:46.881600+0000","last_clean":"2022-09-17T10:27:46.881600+0000","last_became_active":"2022-09-17T10:27:46.878700+0000","last_became_peered":"2022-09-17T10:27:46.878700+0000","last_unstale":"2022-09-17T10:27:46.881600+0000","last_undegraded":"2022-09-17T10:27:46.881600+0000","last_fullsized":"2022-09-17T10:27:46.881600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832695+0000","last_change":"2022-09-17T10:27:42.817890+0000","last_active":"2022-09-17T10:27:46.832695+0000","last_peered":"2022-09-17T10:27:46.832695+0000","last_clean":"2022-09-17T10:27:46.832695+0000","last_became_active":"2022-09-17T10:27:42.817601+0000","last_became_peered":"2022-09-17T10:27:42.817601+0000","last_unstale":"2022-09-17T10:27:46.832695+0000","last_undegraded":"2022-09-17T10:27:46.832695+0000","last_fullsized":"2022-09-17T10:27:46.832695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823749+0000","last_change":"2022-09-17T10:27:42.423365+0000","last_active":"2022-09-17T10:27:46.823749+0000","last_peered":"2022-09-17T10:27:46.823749+0000","last_clean":"2022-09-17T10:27:46.823749+0000","last_became_active":"2022-09-17T10:27:42.423033+0000","last_became_peered":"2022-09-17T10:27:42.423033+0000","last_unstale":"2022-09-17T10:27:46.823749+0000","last_undegraded":"2022-09-17T10:27:46.823749+0000","last_fullsized":"2022-09-17T10:27:46.823749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823623+0000","last_change":"2022-09-17T10:27:37.525398+0000","last_active":"2022-09-17T10:27:46.823623+0000","last_peered":"2022-09-17T10:27:46.823623+0000","last_clean":"2022-09-17T10:27:46.823623+0000","last_became_active":"2022-09-17T10:27:37.525103+0000","last_became_peered":"2022-09-17T10:27:37.525103+0000","last_unstale":"2022-09-17T10:27:46.823623+0000","last_undegraded":"2022-09-17T10:27:46.823623+0000","last_fullsized":"2022-09-17T10:27:46.823623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879752+0000","last_change":"2022-09-17T10:27:46.877751+0000","last_active":"2022-09-17T10:27:46.879752+0000","last_peered":"2022-09-17T10:27:46.879752+0000","last_clean":"2022-09-17T10:27:46.879752+0000","last_became_active":"2022-09-17T10:27:46.877299+0000","last_became_peered":"2022-09-17T10:27:46.877299+0000","last_unstale":"2022-09-17T10:27:46.879752+0000","last_undegraded":"2022-09-17T10:27:46.879752+0000","last_fullsized":"2022-09-17T10:27:46.879752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823812+0000","last_change":"2022-09-17T10:27:42.420366+0000","last_active":"2022-09-17T10:27:46.823812+0000","last_peered":"2022-09-17T10:27:46.823812+0000","last_clean":"2022-09-17T10:27:46.823812+0000","last_became_active":"2022-09-17T10:27:42.420013+0000","last_became_peered":"2022-09-17T10:27:42.420013+0000","last_unstale":"2022-09-17T10:27:46.823812+0000","last_undegraded":"2022-09-17T10:27:46.823812+0000","last_fullsized":"2022-09-17T10:27:46.823812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824918+0000","last_change":"2022-09-17T10:27:42.806721+0000","last_active":"2022-09-17T10:27:46.824918+0000","last_peered":"2022-09-17T10:27:46.824918+0000","last_clean":"2022-09-17T10:27:46.824918+0000","last_became_active":"2022-09-17T10:27:42.806357+0000","last_became_peered":"2022-09-17T10:27:42.806357+0000","last_unstale":"2022-09-17T10:27:46.824918+0000","last_undegraded":"2022-09-17T10:27:46.824918+0000","last_fullsized":"2022-09-17T10:27:46.824918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.882851+0000","last_change":"2022-09-17T10:27:46.882310+0000","last_active":"2022-09-17T10:27:46.882851+0000","last_peered":"2022-09-17T10:27:46.882851+0000","last_clean":"2022-09-17T10:27:46.882851+0000","last_became_active":"2022-09-17T10:27:46.881958+0000","last_became_peered":"2022-09-17T10:27:46.881958+0000","last_unstale":"2022-09-17T10:27:46.882851+0000","last_undegraded":"2022-09-17T10:27:46.882851+0000","last_fullsized":"2022-09-17T10:27:46.882851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832635+0000","last_change":"2022-09-17T10:27:42.420727+0000","last_active":"2022-09-17T10:27:46.832635+0000","last_peered":"2022-09-17T10:27:46.832635+0000","last_clean":"2022-09-17T10:27:46.832635+0000","last_became_active":"2022-09-17T10:27:42.420318+0000","last_became_peered":"2022-09-17T10:27:42.420318+0000","last_unstale":"2022-09-17T10:27:46.832635+0000","last_undegraded":"2022-09-17T10:27:46.832635+0000","last_fullsized":"2022-09-17T10:27:46.832635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821086+0000","last_change":"2022-09-17T10:27:42.816236+0000","last_active":"2022-09-17T10:27:46.821086+0000","last_peered":"2022-09-17T10:27:46.821086+0000","last_clean":"2022-09-17T10:27:46.821086+0000","last_became_active":"2022-09-17T10:27:42.815964+0000","last_became_peered":"2022-09-17T10:27:42.815964+0000","last_unstale":"2022-09-17T10:27:46.821086+0000","last_undegraded":"2022-09-17T10:27:46.821086+0000","last_fullsized":"2022-09-17T10:27:46.821086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838996+0000","last_change":"2022-09-17T10:27:46.833473+0000","last_active":"2022-09-17T10:27:46.838996+0000","last_peered":"2022-09-17T10:27:46.838996+0000","last_clean":"2022-09-17T10:27:46.838996+0000","last_became_active":"2022-09-17T10:27:46.832774+0000","last_became_peered":"2022-09-17T10:27:46.832774+0000","last_unstale":"2022-09-17T10:27:46.838996+0000","last_undegraded":"2022-09-17T10:27:46.838996+0000","last_fullsized":"2022-09-17T10:27:46.838996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826647+0000","last_change":"2022-09-17T10:27:42.417006+0000","last_active":"2022-09-17T10:27:46.826647+0000","last_peered":"2022-09-17T10:27:46.826647+0000","last_clean":"2022-09-17T10:27:46.826647+0000","last_became_active":"2022-09-17T10:27:42.416679+0000","last_became_peered":"2022-09-17T10:27:42.416679+0000","last_unstale":"2022-09-17T10:27:46.826647+0000","last_undegraded":"2022-09-17T10:27:46.826647+0000","last_fullsized":"2022-09-17T10:27:46.826647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821361+0000","last_change":"2022-09-17T10:27:42.814951+0000","last_active":"2022-09-17T10:27:46.821361+0000","last_peered":"2022-09-17T10:27:46.821361+0000","last_clean":"2022-09-17T10:27:46.821361+0000","last_became_active":"2022-09-17T10:27:42.814659+0000","last_became_peered":"2022-09-17T10:27:42.814659+0000","last_unstale":"2022-09-17T10:27:46.821361+0000","last_undegraded":"2022-09-17T10:27:46.821361+0000","last_fullsized":"2022-09-17T10:27:46.821361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.836181+0000","last_change":"2022-09-17T10:27:46.835414+0000","last_active":"2022-09-17T10:27:46.836181+0000","last_peered":"2022-09-17T10:27:46.836181+0000","last_clean":"2022-09-17T10:27:46.836181+0000","last_became_active":"2022-09-17T10:27:46.834968+0000","last_became_peered":"2022-09-17T10:27:46.834968+0000","last_unstale":"2022-09-17T10:27:46.836181+0000","last_undegraded":"2022-09-17T10:27:46.836181+0000","last_fullsized":"2022-09-17T10:27:46.836181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.902523+0000","last_change":"2022-09-17T10:27:42.422793+0000","last_active":"2022-09-17T10:27:47.902523+0000","last_peered":"2022-09-17T10:27:47.902523+0000","last_clean":"2022-09-17T10:27:47.902523+0000","last_became_active":"2022-09-17T10:27:42.422337+0000","last_became_peered":"2022-09-17T10:27:42.422337+0000","last_unstale":"2022-09-17T10:27:47.902523+0000","last_undegraded":"2022-09-17T10:27:47.902523+0000","last_fullsized":"2022-09-17T10:27:47.902523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822194+0000","last_change":"2022-09-17T10:27:42.811550+0000","last_active":"2022-09-17T10:27:46.822194+0000","last_peered":"2022-09-17T10:27:46.822194+0000","last_clean":"2022-09-17T10:27:46.822194+0000","last_became_active":"2022-09-17T10:27:42.811253+0000","last_became_peered":"2022-09-17T10:27:42.811253+0000","last_unstale":"2022-09-17T10:27:46.822194+0000","last_undegraded":"2022-09-17T10:27:46.822194+0000","last_fullsized":"2022-09-17T10:27:46.822194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838391+0000","last_change":"2022-09-17T10:27:46.835511+0000","last_active":"2022-09-17T10:27:46.838391+0000","last_peered":"2022-09-17T10:27:46.838391+0000","last_clean":"2022-09-17T10:27:46.838391+0000","last_became_active":"2022-09-17T10:27:46.835134+0000","last_became_peered":"2022-09-17T10:27:46.835134+0000","last_unstale":"2022-09-17T10:27:46.838391+0000","last_undegraded":"2022-09-17T10:27:46.838391+0000","last_fullsized":"2022-09-17T10:27:46.838391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826910+0000","last_change":"2022-09-17T10:27:42.422231+0000","last_active":"2022-09-17T10:27:46.826910+0000","last_peered":"2022-09-17T10:27:46.826910+0000","last_clean":"2022-09-17T10:27:46.826910+0000","last_became_active":"2022-09-17T10:27:42.421108+0000","last_became_peered":"2022-09-17T10:27:42.421108+0000","last_unstale":"2022-09-17T10:27:46.826910+0000","last_undegraded":"2022-09-17T10:27:46.826910+0000","last_fullsized":"2022-09-17T10:27:46.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824550+0000","last_change":"2022-09-17T10:27:42.806733+0000","last_active":"2022-09-17T10:27:46.824550+0000","last_peered":"2022-09-17T10:27:46.824550+0000","last_clean":"2022-09-17T10:27:46.824550+0000","last_became_active":"2022-09-17T10:27:42.806446+0000","last_became_peered":"2022-09-17T10:27:42.806446+0000","last_unstale":"2022-09-17T10:27:46.824550+0000","last_undegraded":"2022-09-17T10:27:46.824550+0000","last_fullsized":"2022-09-17T10:27:46.824550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839217+0000","last_change":"2022-09-17T10:27:46.836402+0000","last_active":"2022-09-17T10:27:46.839217+0000","last_peered":"2022-09-17T10:27:46.839217+0000","last_clean":"2022-09-17T10:27:46.839217+0000","last_became_active":"2022-09-17T10:27:46.836002+0000","last_became_peered":"2022-09-17T10:27:46.836002+0000","last_unstale":"2022-09-17T10:27:46.839217+0000","last_undegraded":"2022-09-17T10:27:46.839217+0000","last_fullsized":"2022-09-17T10:27:46.839217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828495+0000","last_change":"2022-09-17T10:27:42.421493+0000","last_active":"2022-09-17T10:27:46.828495+0000","last_peered":"2022-09-17T10:27:46.828495+0000","last_clean":"2022-09-17T10:27:46.828495+0000","last_became_active":"2022-09-17T10:27:42.421137+0000","last_became_peered":"2022-09-17T10:27:42.421137+0000","last_unstale":"2022-09-17T10:27:46.828495+0000","last_undegraded":"2022-09-17T10:27:46.828495+0000","last_fullsized":"2022-09-17T10:27:46.828495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828502+0000","last_change":"2022-09-17T10:27:42.812206+0000","last_active":"2022-09-17T10:27:46.828502+0000","last_peered":"2022-09-17T10:27:46.828502+0000","last_clean":"2022-09-17T10:27:46.828502+0000","last_became_active":"2022-09-17T10:27:42.811911+0000","last_became_peered":"2022-09-17T10:27:42.811911+0000","last_unstale":"2022-09-17T10:27:46.828502+0000","last_undegraded":"2022-09-17T10:27:46.828502+0000","last_fullsized":"2022-09-17T10:27:46.828502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.837793+0000","last_change":"2022-09-17T10:27:46.836695+0000","last_active":"2022-09-17T10:27:46.837793+0000","last_peered":"2022-09-17T10:27:46.837793+0000","last_clean":"2022-09-17T10:27:46.837793+0000","last_became_active":"2022-09-17T10:27:46.836236+0000","last_became_peered":"2022-09-17T10:27:46.836236+0000","last_unstale":"2022-09-17T10:27:46.837793+0000","last_undegraded":"2022-09-17T10:27:46.837793+0000","last_fullsized":"2022-09-17T10:27:46.837793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822969+0000","last_change":"2022-09-17T10:27:42.418839+0000","last_active":"2022-09-17T10:27:46.822969+0000","last_peered":"2022-09-17T10:27:46.822969+0000","last_clean":"2022-09-17T10:27:46.822969+0000","last_became_active":"2022-09-17T10:27:42.418555+0000","last_became_peered":"2022-09-17T10:27:42.418555+0000","last_unstale":"2022-09-17T10:27:46.822969+0000","last_undegraded":"2022-09-17T10:27:46.822969+0000","last_fullsized":"2022-09-17T10:27:46.822969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825849+0000","last_change":"2022-09-17T10:27:42.820270+0000","last_active":"2022-09-17T10:27:46.825849+0000","last_peered":"2022-09-17T10:27:46.825849+0000","last_clean":"2022-09-17T10:27:46.825849+0000","last_became_active":"2022-09-17T10:27:42.820082+0000","last_became_peered":"2022-09-17T10:27:42.820082+0000","last_unstale":"2022-09-17T10:27:46.825849+0000","last_undegraded":"2022-09-17T10:27:46.825849+0000","last_fullsized":"2022-09-17T10:27:46.825849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832187+0000","last_change":"2022-09-17T10:27:46.830924+0000","last_active":"2022-09-17T10:27:46.832187+0000","last_peered":"2022-09-17T10:27:46.832187+0000","last_clean":"2022-09-17T10:27:46.832187+0000","last_became_active":"2022-09-17T10:27:46.830492+0000","last_became_peered":"2022-09-17T10:27:46.830492+0000","last_unstale":"2022-09-17T10:27:46.832187+0000","last_undegraded":"2022-09-17T10:27:46.832187+0000","last_fullsized":"2022-09-17T10:27:46.832187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.902985+0000","last_change":"2022-09-17T10:27:42.419790+0000","last_active":"2022-09-17T10:27:47.902985+0000","last_peered":"2022-09-17T10:27:47.902985+0000","last_clean":"2022-09-17T10:27:47.902985+0000","last_became_active":"2022-09-17T10:27:42.419230+0000","last_became_peered":"2022-09-17T10:27:42.419230+0000","last_unstale":"2022-09-17T10:27:47.902985+0000","last_undegraded":"2022-09-17T10:27:47.902985+0000","last_fullsized":"2022-09-17T10:27:47.902985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825970+0000","last_change":"2022-09-17T10:27:42.818878+0000","last_active":"2022-09-17T10:27:46.825970+0000","last_peered":"2022-09-17T10:27:46.825970+0000","last_clean":"2022-09-17T10:27:46.825970+0000","last_became_active":"2022-09-17T10:27:42.818634+0000","last_became_peered":"2022-09-17T10:27:42.818634+0000","last_unstale":"2022-09-17T10:27:46.825970+0000","last_undegraded":"2022-09-17T10:27:46.825970+0000","last_fullsized":"2022-09-17T10:27:46.825970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839835+0000","last_change":"2022-09-17T10:27:46.832459+0000","last_active":"2022-09-17T10:27:46.839835+0000","last_peered":"2022-09-17T10:27:46.839835+0000","last_clean":"2022-09-17T10:27:46.839835+0000","last_became_active":"2022-09-17T10:27:46.831882+0000","last_became_peered":"2022-09-17T10:27:46.831882+0000","last_unstale":"2022-09-17T10:27:46.839835+0000","last_undegraded":"2022-09-17T10:27:46.839835+0000","last_fullsized":"2022-09-17T10:27:46.839835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"26'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826302+0000","last_change":"2022-09-17T10:27:42.418968+0000","last_active":"2022-09-17T10:27:46.826302+0000","last_peered":"2022-09-17T10:27:46.826302+0000","last_clean":"2022-09-17T10:27:46.826302+0000","last_became_active":"2022-09-17T10:27:42.418688+0000","last_became_peered":"2022-09-17T10:27:42.418688+0000","last_unstale":"2022-09-17T10:27:46.826302+0000","last_undegraded":"2022-09-17T10:27:46.826302+0000","last_fullsized":"2022-09-17T10:27:46.826302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824990+0000","last_change":"2022-09-17T10:27:42.811058+0000","last_active":"2022-09-17T10:27:46.824990+0000","last_peered":"2022-09-17T10:27:46.824990+0000","last_clean":"2022-09-17T10:27:46.824990+0000","last_became_active":"2022-09-17T10:27:42.810786+0000","last_became_peered":"2022-09-17T10:27:42.810786+0000","last_unstale":"2022-09-17T10:27:46.824990+0000","last_undegraded":"2022-09-17T10:27:46.824990+0000","last_fullsized":"2022-09-17T10:27:46.824990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879743+0000","last_change":"2022-09-17T10:27:46.878357+0000","last_active":"2022-09-17T10:27:46.879743+0000","last_peered":"2022-09-17T10:27:46.879743+0000","last_clean":"2022-09-17T10:27:46.879743+0000","last_became_active":"2022-09-17T10:27:46.877905+0000","last_became_peered":"2022-09-17T10:27:46.877905+0000","last_unstale":"2022-09-17T10:27:46.879743+0000","last_undegraded":"2022-09-17T10:27:46.879743+0000","last_fullsized":"2022-09-17T10:27:46.879743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825843+0000","last_change":"2022-09-17T10:27:42.423000+0000","last_active":"2022-09-17T10:27:46.825843+0000","last_peered":"2022-09-17T10:27:46.825843+0000","last_clean":"2022-09-17T10:27:46.825843+0000","last_became_active":"2022-09-17T10:27:42.422682+0000","last_became_peered":"2022-09-17T10:27:42.422682+0000","last_unstale":"2022-09-17T10:27:46.825843+0000","last_undegraded":"2022-09-17T10:27:46.825843+0000","last_fullsized":"2022-09-17T10:27:46.825843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879543+0000","last_change":"2022-09-17T10:27:42.811159+0000","last_active":"2022-09-17T10:27:46.879543+0000","last_peered":"2022-09-17T10:27:46.879543+0000","last_clean":"2022-09-17T10:27:46.879543+0000","last_became_active":"2022-09-17T10:27:42.810820+0000","last_became_peered":"2022-09-17T10:27:42.810820+0000","last_unstale":"2022-09-17T10:27:46.879543+0000","last_undegraded":"2022-09-17T10:27:46.879543+0000","last_fullsized":"2022-09-17T10:27:46.879543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839921+0000","last_change":"2022-09-17T10:27:46.838653+0000","last_active":"2022-09-17T10:27:46.839921+0000","last_peered":"2022-09-17T10:27:46.839921+0000","last_clean":"2022-09-17T10:27:46.839921+0000","last_became_active":"2022-09-17T10:27:46.838287+0000","last_became_peered":"2022-09-17T10:27:46.838287+0000","last_unstale":"2022-09-17T10:27:46.839921+0000","last_undegraded":"2022-09-17T10:27:46.839921+0000","last_fullsized":"2022-09-17T10:27:46.839921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877630+0000","last_change":"2022-09-17T10:27:42.419648+0000","last_active":"2022-09-17T10:27:46.877630+0000","last_peered":"2022-09-17T10:27:46.877630+0000","last_clean":"2022-09-17T10:27:46.877630+0000","last_became_active":"2022-09-17T10:27:42.419364+0000","last_became_peered":"2022-09-17T10:27:42.419364+0000","last_unstale":"2022-09-17T10:27:46.877630+0000","last_undegraded":"2022-09-17T10:27:46.877630+0000","last_fullsized":"2022-09-17T10:27:46.877630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826647+0000","last_change":"2022-09-17T10:27:42.816825+0000","last_active":"2022-09-17T10:27:46.826647+0000","last_peered":"2022-09-17T10:27:46.826647+0000","last_clean":"2022-09-17T10:27:46.826647+0000","last_became_active":"2022-09-17T10:27:42.816570+0000","last_became_peered":"2022-09-17T10:27:42.816570+0000","last_unstale":"2022-09-17T10:27:46.826647+0000","last_undegraded":"2022-09-17T10:27:46.826647+0000","last_fullsized":"2022-09-17T10:27:46.826647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841041+0000","last_change":"2022-09-17T10:27:46.840020+0000","last_active":"2022-09-17T10:27:46.841041+0000","last_peered":"2022-09-17T10:27:46.841041+0000","last_clean":"2022-09-17T10:27:46.841041+0000","last_became_active":"2022-09-17T10:27:46.839506+0000","last_became_peered":"2022-09-17T10:27:46.839506+0000","last_unstale":"2022-09-17T10:27:46.841041+0000","last_undegraded":"2022-09-17T10:27:46.841041+0000","last_fullsized":"2022-09-17T10:27:46.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.903171+0000","last_change":"2022-09-17T10:27:42.422080+0000","last_active":"2022-09-17T10:27:47.903171+0000","last_peered":"2022-09-17T10:27:47.903171+0000","last_clean":"2022-09-17T10:27:47.903171+0000","last_became_active":"2022-09-17T10:27:42.421800+0000","last_became_peered":"2022-09-17T10:27:42.421800+0000","last_unstale":"2022-09-17T10:27:47.903171+0000","last_undegraded":"2022-09-17T10:27:47.903171+0000","last_fullsized":"2022-09-17T10:27:47.903171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822002+0000","last_change":"2022-09-17T10:27:42.813833+0000","last_active":"2022-09-17T10:27:46.822002+0000","last_peered":"2022-09-17T10:27:46.822002+0000","last_clean":"2022-09-17T10:27:46.822002+0000","last_became_active":"2022-09-17T10:27:42.813026+0000","last_became_peered":"2022-09-17T10:27:42.813026+0000","last_unstale":"2022-09-17T10:27:46.822002+0000","last_undegraded":"2022-09-17T10:27:46.822002+0000","last_fullsized":"2022-09-17T10:27:46.822002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838329+0000","last_change":"2022-09-17T10:27:46.836347+0000","last_active":"2022-09-17T10:27:46.838329+0000","last_peered":"2022-09-17T10:27:46.838329+0000","last_clean":"2022-09-17T10:27:46.838329+0000","last_became_active":"2022-09-17T10:27:46.835868+0000","last_became_peered":"2022-09-17T10:27:46.835868+0000","last_unstale":"2022-09-17T10:27:46.838329+0000","last_undegraded":"2022-09-17T10:27:46.838329+0000","last_fullsized":"2022-09-17T10:27:46.838329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"26'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:28:01.974641+0000","last_change":"2022-09-17T10:27:42.418108+0000","last_active":"2022-09-17T10:28:01.974641+0000","last_peered":"2022-09-17T10:28:01.974641+0000","last_clean":"2022-09-17T10:28:01.974641+0000","last_became_active":"2022-09-17T10:27:42.417757+0000","last_became_peered":"2022-09-17T10:27:42.417757+0000","last_unstale":"2022-09-17T10:28:01.974641+0000","last_undegraded":"2022-09-17T10:28:01.974641+0000","last_fullsized":"2022-09-17T10:28:01.974641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821123+0000","last_change":"2022-09-17T10:27:42.817463+0000","last_active":"2022-09-17T10:27:46.821123+0000","last_peered":"2022-09-17T10:27:46.821123+0000","last_clean":"2022-09-17T10:27:46.821123+0000","last_became_active":"2022-09-17T10:27:42.816834+0000","last_became_peered":"2022-09-17T10:27:42.816834+0000","last_unstale":"2022-09-17T10:27:46.821123+0000","last_undegraded":"2022-09-17T10:27:46.821123+0000","last_fullsized":"2022-09-17T10:27:46.821123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841734+0000","last_change":"2022-09-17T10:27:46.841024+0000","last_active":"2022-09-17T10:27:46.841734+0000","last_peered":"2022-09-17T10:27:46.841734+0000","last_clean":"2022-09-17T10:27:46.841734+0000","last_became_active":"2022-09-17T10:27:46.840603+0000","last_became_peered":"2022-09-17T10:27:46.840603+0000","last_unstale":"2022-09-17T10:27:46.841734+0000","last_undegraded":"2022-09-17T10:27:46.841734+0000","last_fullsized":"2022-09-17T10:27:46.841734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"26'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832780+0000","last_change":"2022-09-17T10:27:42.420701+0000","last_active":"2022-09-17T10:27:46.832780+0000","last_peered":"2022-09-17T10:27:46.832780+0000","last_clean":"2022-09-17T10:27:46.832780+0000","last_became_active":"2022-09-17T10:27:42.420411+0000","last_became_peered":"2022-09-17T10:27:42.420411+0000","last_unstale":"2022-09-17T10:27:46.832780+0000","last_undegraded":"2022-09-17T10:27:46.832780+0000","last_fullsized":"2022-09-17T10:27:46.832780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824113+0000","last_change":"2022-09-17T10:27:42.815787+0000","last_active":"2022-09-17T10:27:46.824113+0000","last_peered":"2022-09-17T10:27:46.824113+0000","last_clean":"2022-09-17T10:27:46.824113+0000","last_became_active":"2022-09-17T10:27:42.815574+0000","last_became_peered":"2022-09-17T10:27:42.815574+0000","last_unstale":"2022-09-17T10:27:46.824113+0000","last_undegraded":"2022-09-17T10:27:46.824113+0000","last_fullsized":"2022-09-17T10:27:46.824113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841390+0000","last_change":"2022-09-17T10:27:46.840878+0000","last_active":"2022-09-17T10:27:46.841390+0000","last_peered":"2022-09-17T10:27:46.841390+0000","last_clean":"2022-09-17T10:27:46.841390+0000","last_became_active":"2022-09-17T10:27:46.840406+0000","last_became_peered":"2022-09-17T10:27:46.840406+0000","last_unstale":"2022-09-17T10:27:46.841390+0000","last_undegraded":"2022-09-17T10:27:46.841390+0000","last_fullsized":"2022-09-17T10:27:46.841390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.829101+0000","last_change":"2022-09-17T10:27:42.416329+0000","last_active":"2022-09-17T10:27:46.829101+0000","last_peered":"2022-09-17T10:27:46.829101+0000","last_clean":"2022-09-17T10:27:46.829101+0000","last_became_active":"2022-09-17T10:27:42.415993+0000","last_became_peered":"2022-09-17T10:27:42.415993+0000","last_unstale":"2022-09-17T10:27:46.829101+0000","last_undegraded":"2022-09-17T10:27:46.829101+0000","last_fullsized":"2022-09-17T10:27:46.829101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831132+0000","last_change":"2022-09-17T10:27:42.816319+0000","last_active":"2022-09-17T10:27:46.831132+0000","last_peered":"2022-09-17T10:27:46.831132+0000","last_clean":"2022-09-17T10:27:46.831132+0000","last_became_active":"2022-09-17T10:27:42.815852+0000","last_became_peered":"2022-09-17T10:27:42.815852+0000","last_unstale":"2022-09-17T10:27:46.831132+0000","last_undegraded":"2022-09-17T10:27:46.831132+0000","last_fullsized":"2022-09-17T10:27:46.831132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838936+0000","last_change":"2022-09-17T10:27:46.834933+0000","last_active":"2022-09-17T10:27:46.838936+0000","last_peered":"2022-09-17T10:27:46.838936+0000","last_clean":"2022-09-17T10:27:46.838936+0000","last_became_active":"2022-09-17T10:27:46.834522+0000","last_became_peered":"2022-09-17T10:27:46.834522+0000","last_unstale":"2022-09-17T10:27:46.838936+0000","last_undegraded":"2022-09-17T10:27:46.838936+0000","last_fullsized":"2022-09-17T10:27:46.838936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823794+0000","last_change":"2022-09-17T10:27:42.421873+0000","last_active":"2022-09-17T10:27:46.823794+0000","last_peered":"2022-09-17T10:27:46.823794+0000","last_clean":"2022-09-17T10:27:46.823794+0000","last_became_active":"2022-09-17T10:27:42.421587+0000","last_became_peered":"2022-09-17T10:27:42.421587+0000","last_unstale":"2022-09-17T10:27:46.823794+0000","last_undegraded":"2022-09-17T10:27:46.823794+0000","last_fullsized":"2022-09-17T10:27:46.823794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823867+0000","last_change":"2022-09-17T10:27:42.805008+0000","last_active":"2022-09-17T10:27:46.823867+0000","last_peered":"2022-09-17T10:27:46.823867+0000","last_clean":"2022-09-17T10:27:46.823867+0000","last_became_active":"2022-09-17T10:27:42.804736+0000","last_became_peered":"2022-09-17T10:27:42.804736+0000","last_unstale":"2022-09-17T10:27:46.823867+0000","last_undegraded":"2022-09-17T10:27:46.823867+0000","last_fullsized":"2022-09-17T10:27:46.823867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.840417+0000","last_change":"2022-09-17T10:27:46.839700+0000","last_active":"2022-09-17T10:27:46.840417+0000","last_peered":"2022-09-17T10:27:46.840417+0000","last_clean":"2022-09-17T10:27:46.840417+0000","last_became_active":"2022-09-17T10:27:46.839222+0000","last_became_peered":"2022-09-17T10:27:46.839222+0000","last_unstale":"2022-09-17T10:27:46.840417+0000","last_undegraded":"2022-09-17T10:27:46.840417+0000","last_fullsized":"2022-09-17T10:27:46.840417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.837453+0000","last_change":"2022-09-17T10:27:46.835973+0000","last_active":"2022-09-17T10:27:46.837453+0000","last_peered":"2022-09-17T10:27:46.837453+0000","last_clean":"2022-09-17T10:27:46.837453+0000","last_became_active":"2022-09-17T10:27:46.835370+0000","last_became_peered":"2022-09-17T10:27:46.835370+0000","last_unstale":"2022-09-17T10:27:46.837453+0000","last_undegraded":"2022-09-17T10:27:46.837453+0000","last_fullsized":"2022-09-17T10:27:46.837453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830729+0000","last_change":"2022-09-17T10:27:42.424396+0000","last_active":"2022-09-17T10:27:46.830729+0000","last_peered":"2022-09-17T10:27:46.830729+0000","last_clean":"2022-09-17T10:27:46.830729+0000","last_became_active":"2022-09-17T10:27:42.424106+0000","last_became_peered":"2022-09-17T10:27:42.424106+0000","last_unstale":"2022-09-17T10:27:46.830729+0000","last_undegraded":"2022-09-17T10:27:46.830729+0000","last_fullsized":"2022-09-17T10:27:46.830729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822522+0000","last_change":"2022-09-17T10:27:42.813371+0000","last_active":"2022-09-17T10:27:46.822522+0000","last_peered":"2022-09-17T10:27:46.822522+0000","last_clean":"2022-09-17T10:27:46.822522+0000","last_became_active":"2022-09-17T10:27:42.813093+0000","last_became_peered":"2022-09-17T10:27:42.813093+0000","last_unstale":"2022-09-17T10:27:46.822522+0000","last_undegraded":"2022-09-17T10:27:46.822522+0000","last_fullsized":"2022-09-17T10:27:46.822522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838300+0000","last_change":"2022-09-17T10:27:46.836367+0000","last_active":"2022-09-17T10:27:46.838300+0000","last_peered":"2022-09-17T10:27:46.838300+0000","last_clean":"2022-09-17T10:27:46.838300+0000","last_became_active":"2022-09-17T10:27:46.835670+0000","last_became_peered":"2022-09-17T10:27:46.835670+0000","last_unstale":"2022-09-17T10:27:46.838300+0000","last_undegraded":"2022-09-17T10:27:46.838300+0000","last_fullsized":"2022-09-17T10:27:46.838300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823937+0000","last_change":"2022-09-17T10:27:42.425999+0000","last_active":"2022-09-17T10:27:46.823937+0000","last_peered":"2022-09-17T10:27:46.823937+0000","last_clean":"2022-09-17T10:27:46.823937+0000","last_became_active":"2022-09-17T10:27:42.425650+0000","last_became_peered":"2022-09-17T10:27:42.425650+0000","last_unstale":"2022-09-17T10:27:46.823937+0000","last_undegraded":"2022-09-17T10:27:46.823937+0000","last_fullsized":"2022-09-17T10:27:46.823937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823053+0000","last_change":"2022-09-17T10:27:42.807915+0000","last_active":"2022-09-17T10:27:46.823053+0000","last_peered":"2022-09-17T10:27:46.823053+0000","last_clean":"2022-09-17T10:27:46.823053+0000","last_became_active":"2022-09-17T10:27:42.807621+0000","last_became_peered":"2022-09-17T10:27:42.807621+0000","last_unstale":"2022-09-17T10:27:46.823053+0000","last_undegraded":"2022-09-17T10:27:46.823053+0000","last_fullsized":"2022-09-17T10:27:46.823053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832588+0000","last_change":"2022-09-17T10:27:42.418946+0000","last_active":"2022-09-17T10:27:46.832588+0000","last_peered":"2022-09-17T10:27:46.832588+0000","last_clean":"2022-09-17T10:27:46.832588+0000","last_became_active":"2022-09-17T10:27:42.418576+0000","last_became_peered":"2022-09-17T10:27:42.418576+0000","last_unstale":"2022-09-17T10:27:46.832588+0000","last_undegraded":"2022-09-17T10:27:46.832588+0000","last_fullsized":"2022-09-17T10:27:46.832588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824054+0000","last_change":"2022-09-17T10:27:42.817091+0000","last_active":"2022-09-17T10:27:46.824054+0000","last_peered":"2022-09-17T10:27:46.824054+0000","last_clean":"2022-09-17T10:27:46.824054+0000","last_became_active":"2022-09-17T10:27:42.816783+0000","last_became_peered":"2022-09-17T10:27:42.816783+0000","last_unstale":"2022-09-17T10:27:46.824054+0000","last_undegraded":"2022-09-17T10:27:46.824054+0000","last_fullsized":"2022-09-17T10:27:46.824054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879369+0000","last_change":"2022-09-17T10:27:46.878071+0000","last_active":"2022-09-17T10:27:46.879369+0000","last_peered":"2022-09-17T10:27:46.879369+0000","last_clean":"2022-09-17T10:27:46.879369+0000","last_became_active":"2022-09-17T10:27:46.877621+0000","last_became_peered":"2022-09-17T10:27:46.877621+0000","last_unstale":"2022-09-17T10:27:46.879369+0000","last_undegraded":"2022-09-17T10:27:46.879369+0000","last_fullsized":"2022-09-17T10:27:46.879369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444042,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":161829,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":164234,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":9,"up_from":17,"seq":73014444042,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":8,"up_from":17,"seq":73014444041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":161897,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":161219,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":6,"up_from":17,"seq":73014444040,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":17,"seq":73014444042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":162361,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":0,"up_from":17,"seq":73014444041,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":161233,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":3,"up_from":17,"seq":73014444041,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":161233,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":4,"up_from":17,"seq":73014444042,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5392,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366448,"statfs":{"total":96636764160,"available":96631242752,"internally_reserved":0,"allocated":335872,"data_stored":164268,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-09-17T10:28:08.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-09-17T10:28:08.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.702+0000 7f7916614700 1 Processor -- start 2022-09-17T10:28:08.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.702+0000 7f7916614700 1 -- start start 2022-09-17T10:28:08.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.703+0000 7f7916614700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f79101753a0 0x7f79100ea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.703+0000 7f7916614700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100ed5b0 con 0x7f7910174fc0 2022-09-17T10:28:08.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.703+0000 7f7916614700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100ed890 con 0x7f79100eaeb0 2022-09-17T10:28:08.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.703+0000 7f7916614700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7910182b90 con 0x7f79101753a0 2022-09-17T10:28:08.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.703+0000 7f7915612700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7910174fc0 0x7f79100ecda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57796/0 (socket says 172.21.15.62:57796) 2022-09-17T10:28:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.703+0000 7f7915612700 1 -- 172.21.15.62:0/1673482220 learned_addr learned my addr 172.21.15.62:0/1673482220 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013116630 0 0) 0x7f79100ed5b0 con 0x7f7910174fc0 2022-09-17T10:28:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7914e11700 1 --2- 172.21.15.62:0/1673482220 >> v2:172.21.15.93:3300/0 conn(0x7f79101753a0 0x7f79100ea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78fc0033f0 con 0x7f7910174fc0 2022-09-17T10:28:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1579652776 0 0) 0x7f78fc0033f0 con 0x7f7910174fc0 2022-09-17T10:28:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 >> v2:172.21.15.93:3300/0 conn(0x7f79101753a0 msgr2=0x7f79100ea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 --2- 172.21.15.62:0/1673482220 >> v2:172.21.15.93:3300/0 conn(0x7f79101753a0 0x7f79100ea9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 >> v1:172.21.15.159:6789/0 conn(0x7f79100eaeb0 legacy=0x7f79100ee730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100edb70 con 0x7f7910174fc0 2022-09-17T10:28:08.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f79000017f0 con 0x7f7910174fc0 2022-09-17T10:28:08.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 >> v1:172.21.15.62:6789/0 conn(0x7f7910174fc0 legacy=0x7f79100ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0038e0 0x7f78fc003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78fc004690 0x7f78fc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78fc005000 0x7f78fc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc00beb0 con 0x7f78fc005000 2022-09-17T10:28:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc00c020 con 0x7f78fc0038e0 2022-09-17T10:28:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc00c1e0 con 0x7f78fc004690 2022-09-17T10:28:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915e13700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78fc005000 0x7f78fc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7914e11700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78fc004690 0x7f78fc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915612700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0038e0 0x7f78fc003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915e13700 1 -- 172.21.15.62:0/1673482220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78fc004690 msgr2=0x7f78fc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915e13700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78fc004690 0x7f78fc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915e13700 1 -- 172.21.15.62:0/1673482220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0038e0 msgr2=0x7f78fc003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915e13700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0038e0 0x7f78fc003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915e13700 1 -- 172.21.15.62:0/1673482220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0033f0 con 0x7f78fc005000 2022-09-17T10:28:08.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915e13700 1 -- 172.21.15.62:0/1673482220 reap_dead start 2022-09-17T10:28:08.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.704+0000 7f7915e13700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78fc005000 0x7f78fc00b8e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f7908001820 tx=0x7f7908007b90).ready entity=mon.0 client_cookie=b9f8e5b79f825b24 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908007ea0 con 0x7f78fc005000 2022-09-17T10:28:08.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908012400 con 0x7f78fc005000 2022-09-17T10:28:08.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f790ffff700 1 -- 172.21.15.62:0/1673482220 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080127c0 con 0x7f78fc005000 2022-09-17T10:28:08.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f7916614700 1 -- 172.21.15.62:0/1673482220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78fc005000 msgr2=0x7f78fc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f7916614700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78fc005000 0x7f78fc00b8e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f7908001820 tx=0x7f7908007b90).stop 2022-09-17T10:28:08.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f7916614700 1 -- 172.21.15.62:0/1673482220 shutdown_connections 2022-09-17T10:28:08.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f7916614700 1 --2- 172.21.15.62:0/1673482220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78fc005000 0x7f78fc00b8e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f7916614700 1 -- 172.21.15.62:0/1673482220 >> 172.21.15.62:0/1673482220 conn(0x7f791005d9a0 msgr2=0x7f791005ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:08.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f7916614700 1 -- 172.21.15.62:0/1673482220 shutdown_connections 2022-09-17T10:28:08.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.705+0000 7f7916614700 1 -- 172.21.15.62:0/1673482220 wait complete. 2022-09-17T10:28:08.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.707+0000 7f7916614700 1 Processor -- start 2022-09-17T10:28:08.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.707+0000 7f7916614700 1 -- start start 2022-09-17T10:28:08.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7916614700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc005000 0x7f7910182d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7916614700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791014f9d0 0x7f791014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7916614700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79100e6c40 0x7f79100e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7916614700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910180b80 con 0x7f79100e6c40 2022-09-17T10:28:08.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7916614700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910181c80 con 0x7f78fc005000 2022-09-17T10:28:08.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7916614700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910150340 con 0x7f791014f9d0 2022-09-17T10:28:08.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79100e6c40 0x7f79100e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79100e6c40 0x7f79100e70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50108/0 (socket says 172.21.15.62:50108) 2022-09-17T10:28:08.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 -- 172.21.15.62:0/1544257506 learned_addr learned my addr 172.21.15.62:0/1544257506 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:08.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915612700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc005000 0x7f7910182d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7914e11700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791014f9d0 0x7f791014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 -- 172.21.15.62:0/1544257506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791014f9d0 msgr2=0x7f791014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791014f9d0 0x7f791014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 -- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc005000 msgr2=0x7f7910182d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc005000 0x7f7910182d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 -- 172.21.15.62:0/1544257506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100ec4f0 con 0x7f79100e6c40 2022-09-17T10:28:08.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7914e11700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791014f9d0 0x7f791014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:08.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915612700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc005000 0x7f7910182d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:08.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7915e13700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79100e6c40 0x7f79100e70c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f7908001e10 tx=0x7f7908016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f790d7fa700 1 -- 172.21.15.62:0/1544257506 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908007ea0 con 0x7f79100e6c40 2022-09-17T10:28:08.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f790d7fa700 1 -- 172.21.15.62:0/1544257506 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908012780 con 0x7f79100e6c40 2022-09-17T10:28:08.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7910180d90 con 0x7f79100e6c40 2022-09-17T10:28:08.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.708+0000 7f790d7fa700 1 -- 172.21.15.62:0/1544257506 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908011de0 con 0x7f79100e6c40 2022-09-17T10:28:08.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.709+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7910181350 con 0x7f79100e6c40 2022-09-17T10:28:08.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.709+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7910181e10 con 0x7f79100e6c40 2022-09-17T10:28:08.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.710+0000 7f790d7fa700 1 -- 172.21.15.62:0/1544257506 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f7908010070 con 0x7f79100e6c40 2022-09-17T10:28:08.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.711+0000 7f790d7fa700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f78f008ba40 0x7f78f008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:08.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.711+0000 7f790d7fa700 1 -- 172.21.15.62:0/1544257506 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f79080b1570 con 0x7f79100e6c40 2022-09-17T10:28:08.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.711+0000 7f7915612700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f78f008ba40 0x7f78f008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:08.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.711+0000 7f7915612700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f78f008ba40 0x7f78f008df00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7900001920 tx=0x7f7900009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:08.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.715+0000 7f790d7fa700 1 -- 172.21.15.62:0/1544257506 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f79080528d0 con 0x7f79100e6c40 2022-09-17T10:28:08.884 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.882+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 --> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7910180b80 con 0x7f78f008ba40 2022-09-17T10:28:08.896 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.894+0000 7f790d7fa700 1 -- 172.21.15.62:0/1544257506 <== mgr.4114 v2:172.21.15.93:6832/81423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434667 (secure 0 0 0) 0x7f7910180b80 con 0x7f78f008ba40 2022-09-17T10:28:08.902 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:08.908 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f78f008ba40 msgr2=0x7f78f008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.909 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f78f008ba40 0x7f78f008df00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7900001920 tx=0x7f7900009040).stop 2022-09-17T10:28:08.909 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79100e6c40 msgr2=0x7f79100e70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:08.910 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79100e6c40 0x7f79100e70c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f7908001e10 tx=0x7f7908016000).stop 2022-09-17T10:28:08.910 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 shutdown_connections 2022-09-17T10:28:08.910 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f78f008ba40 0x7f78f008df00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.911 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc005000 0x7f7910182d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.911 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79100e6c40 0x7f79100e70c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.911 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 --2- 172.21.15.62:0/1544257506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791014f9d0 0x7f791014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:08.911 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 >> 172.21.15.62:0/1544257506 conn(0x7f791005d9a0 msgr2=0x7f79100ba990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:08.912 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 shutdown_connections 2022-09-17T10:28:08.912 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:08.898+0000 7f7916614700 1 -- 172.21.15.62:0/1544257506 wait complete. 2022-09-17T10:28:08.912 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2022-09-17T10:28:08.914 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2022-09-17T10:28:06.882959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":63968,"kb_used_data":3904,"kb_used_omap":0,"kb_used_meta":59968,"kb_avail":1132398112,"statfs":{"total":1159641169920,"available":1159575666688,"internally_reserved":0,"allocated":3997696,"data_stored":1942926,"data_compressed":133308,"data_compressed_allocated":196608,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":61407232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003827"},"pg_stats":[{"pgid":"3.3f","version":"26'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.205131+0000","last_change":"2022-09-17T10:27:42.422299+0000","last_active":"2022-09-17T10:27:47.205131+0000","last_peered":"2022-09-17T10:27:47.205131+0000","last_clean":"2022-09-17T10:27:47.205131+0000","last_became_active":"2022-09-17T10:27:42.421964+0000","last_became_peered":"2022-09-17T10:27:42.421964+0000","last_unstale":"2022-09-17T10:27:47.205131+0000","last_undegraded":"2022-09-17T10:27:47.205131+0000","last_fullsized":"2022-09-17T10:27:47.205131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826597+0000","last_change":"2022-09-17T10:27:42.817398+0000","last_active":"2022-09-17T10:27:46.826597+0000","last_peered":"2022-09-17T10:27:46.826597+0000","last_clean":"2022-09-17T10:27:46.826597+0000","last_became_active":"2022-09-17T10:27:42.816997+0000","last_became_peered":"2022-09-17T10:27:42.816997+0000","last_unstale":"2022-09-17T10:27:46.826597+0000","last_undegraded":"2022-09-17T10:27:46.826597+0000","last_fullsized":"2022-09-17T10:27:46.826597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823263+0000","last_change":"2022-09-17T10:27:42.420800+0000","last_active":"2022-09-17T10:27:46.823263+0000","last_peered":"2022-09-17T10:27:46.823263+0000","last_clean":"2022-09-17T10:27:46.823263+0000","last_became_active":"2022-09-17T10:27:42.420493+0000","last_became_peered":"2022-09-17T10:27:42.420493+0000","last_unstale":"2022-09-17T10:27:46.823263+0000","last_undegraded":"2022-09-17T10:27:46.823263+0000","last_fullsized":"2022-09-17T10:27:46.823263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828146+0000","last_change":"2022-09-17T10:27:42.813032+0000","last_active":"2022-09-17T10:27:46.828146+0000","last_peered":"2022-09-17T10:27:46.828146+0000","last_clean":"2022-09-17T10:27:46.828146+0000","last_became_active":"2022-09-17T10:27:42.812613+0000","last_became_peered":"2022-09-17T10:27:42.812613+0000","last_unstale":"2022-09-17T10:27:46.828146+0000","last_undegraded":"2022-09-17T10:27:46.828146+0000","last_fullsized":"2022-09-17T10:27:46.828146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823043+0000","last_change":"2022-09-17T10:27:42.419699+0000","last_active":"2022-09-17T10:27:46.823043+0000","last_peered":"2022-09-17T10:27:46.823043+0000","last_clean":"2022-09-17T10:27:46.823043+0000","last_became_active":"2022-09-17T10:27:42.419381+0000","last_became_peered":"2022-09-17T10:27:42.419381+0000","last_unstale":"2022-09-17T10:27:46.823043+0000","last_undegraded":"2022-09-17T10:27:46.823043+0000","last_fullsized":"2022-09-17T10:27:46.823043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821000+0000","last_change":"2022-09-17T10:27:42.812216+0000","last_active":"2022-09-17T10:27:46.821000+0000","last_peered":"2022-09-17T10:27:46.821000+0000","last_clean":"2022-09-17T10:27:46.821000+0000","last_became_active":"2022-09-17T10:27:42.811495+0000","last_became_peered":"2022-09-17T10:27:42.811495+0000","last_unstale":"2022-09-17T10:27:46.821000+0000","last_undegraded":"2022-09-17T10:27:46.821000+0000","last_fullsized":"2022-09-17T10:27:46.821000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821860+0000","last_change":"2022-09-17T10:27:42.423214+0000","last_active":"2022-09-17T10:27:46.821860+0000","last_peered":"2022-09-17T10:27:46.821860+0000","last_clean":"2022-09-17T10:27:46.821860+0000","last_became_active":"2022-09-17T10:27:42.422645+0000","last_became_peered":"2022-09-17T10:27:42.422645+0000","last_unstale":"2022-09-17T10:27:46.821860+0000","last_undegraded":"2022-09-17T10:27:46.821860+0000","last_fullsized":"2022-09-17T10:27:46.821860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821942+0000","last_change":"2022-09-17T10:27:42.816222+0000","last_active":"2022-09-17T10:27:46.821942+0000","last_peered":"2022-09-17T10:27:46.821942+0000","last_clean":"2022-09-17T10:27:46.821942+0000","last_became_active":"2022-09-17T10:27:42.815835+0000","last_became_peered":"2022-09-17T10:27:42.815835+0000","last_unstale":"2022-09-17T10:27:46.821942+0000","last_undegraded":"2022-09-17T10:27:46.821942+0000","last_fullsized":"2022-09-17T10:27:46.821942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.833135+0000","last_change":"2022-09-17T10:27:42.422984+0000","last_active":"2022-09-17T10:27:46.833135+0000","last_peered":"2022-09-17T10:27:46.833135+0000","last_clean":"2022-09-17T10:27:46.833135+0000","last_became_active":"2022-09-17T10:27:42.422710+0000","last_became_peered":"2022-09-17T10:27:42.422710+0000","last_unstale":"2022-09-17T10:27:46.833135+0000","last_undegraded":"2022-09-17T10:27:46.833135+0000","last_fullsized":"2022-09-17T10:27:46.833135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828197+0000","last_change":"2022-09-17T10:27:42.812970+0000","last_active":"2022-09-17T10:27:46.828197+0000","last_peered":"2022-09-17T10:27:46.828197+0000","last_clean":"2022-09-17T10:27:46.828197+0000","last_became_active":"2022-09-17T10:27:42.812675+0000","last_became_peered":"2022-09-17T10:27:42.812675+0000","last_unstale":"2022-09-17T10:27:46.828197+0000","last_undegraded":"2022-09-17T10:27:46.828197+0000","last_fullsized":"2022-09-17T10:27:46.828197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824416+0000","last_change":"2022-09-17T10:27:42.417757+0000","last_active":"2022-09-17T10:27:46.824416+0000","last_peered":"2022-09-17T10:27:46.824416+0000","last_clean":"2022-09-17T10:27:46.824416+0000","last_became_active":"2022-09-17T10:27:42.417425+0000","last_became_peered":"2022-09-17T10:27:42.417425+0000","last_unstale":"2022-09-17T10:27:46.824416+0000","last_undegraded":"2022-09-17T10:27:46.824416+0000","last_fullsized":"2022-09-17T10:27:46.824416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821143+0000","last_change":"2022-09-17T10:27:42.815053+0000","last_active":"2022-09-17T10:27:46.821143+0000","last_peered":"2022-09-17T10:27:46.821143+0000","last_clean":"2022-09-17T10:27:46.821143+0000","last_became_active":"2022-09-17T10:27:42.814772+0000","last_became_peered":"2022-09-17T10:27:42.814772+0000","last_unstale":"2022-09-17T10:27:46.821143+0000","last_undegraded":"2022-09-17T10:27:46.821143+0000","last_fullsized":"2022-09-17T10:27:46.821143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831182+0000","last_change":"2022-09-17T10:27:42.420271+0000","last_active":"2022-09-17T10:27:46.831182+0000","last_peered":"2022-09-17T10:27:46.831182+0000","last_clean":"2022-09-17T10:27:46.831182+0000","last_became_active":"2022-09-17T10:27:42.419991+0000","last_became_peered":"2022-09-17T10:27:42.419991+0000","last_unstale":"2022-09-17T10:27:46.831182+0000","last_undegraded":"2022-09-17T10:27:46.831182+0000","last_fullsized":"2022-09-17T10:27:46.831182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823843+0000","last_change":"2022-09-17T10:27:42.806227+0000","last_active":"2022-09-17T10:27:46.823843+0000","last_peered":"2022-09-17T10:27:46.823843+0000","last_clean":"2022-09-17T10:27:46.823843+0000","last_became_active":"2022-09-17T10:27:42.805882+0000","last_became_peered":"2022-09-17T10:27:42.805882+0000","last_unstale":"2022-09-17T10:27:46.823843+0000","last_undegraded":"2022-09-17T10:27:46.823843+0000","last_fullsized":"2022-09-17T10:27:46.823843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830859+0000","last_change":"2022-09-17T10:27:42.423044+0000","last_active":"2022-09-17T10:27:46.830859+0000","last_peered":"2022-09-17T10:27:46.830859+0000","last_clean":"2022-09-17T10:27:46.830859+0000","last_became_active":"2022-09-17T10:27:42.421055+0000","last_became_peered":"2022-09-17T10:27:42.421055+0000","last_unstale":"2022-09-17T10:27:46.830859+0000","last_undegraded":"2022-09-17T10:27:46.830859+0000","last_fullsized":"2022-09-17T10:27:46.830859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823833+0000","last_change":"2022-09-17T10:27:42.807118+0000","last_active":"2022-09-17T10:27:46.823833+0000","last_peered":"2022-09-17T10:27:46.823833+0000","last_clean":"2022-09-17T10:27:46.823833+0000","last_became_active":"2022-09-17T10:27:42.806225+0000","last_became_peered":"2022-09-17T10:27:42.806225+0000","last_unstale":"2022-09-17T10:27:46.823833+0000","last_undegraded":"2022-09-17T10:27:46.823833+0000","last_fullsized":"2022-09-17T10:27:46.823833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828853+0000","last_change":"2022-09-17T10:27:42.412247+0000","last_active":"2022-09-17T10:27:46.828853+0000","last_peered":"2022-09-17T10:27:46.828853+0000","last_clean":"2022-09-17T10:27:46.828853+0000","last_became_active":"2022-09-17T10:27:42.411939+0000","last_became_peered":"2022-09-17T10:27:42.411939+0000","last_unstale":"2022-09-17T10:27:46.828853+0000","last_undegraded":"2022-09-17T10:27:46.828853+0000","last_fullsized":"2022-09-17T10:27:46.828853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821076+0000","last_change":"2022-09-17T10:27:42.813817+0000","last_active":"2022-09-17T10:27:46.821076+0000","last_peered":"2022-09-17T10:27:46.821076+0000","last_clean":"2022-09-17T10:27:46.821076+0000","last_became_active":"2022-09-17T10:27:42.811044+0000","last_became_peered":"2022-09-17T10:27:42.811044+0000","last_unstale":"2022-09-17T10:27:46.821076+0000","last_undegraded":"2022-09-17T10:27:46.821076+0000","last_fullsized":"2022-09-17T10:27:46.821076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824466+0000","last_change":"2022-09-17T10:27:42.424111+0000","last_active":"2022-09-17T10:27:46.824466+0000","last_peered":"2022-09-17T10:27:46.824466+0000","last_clean":"2022-09-17T10:27:46.824466+0000","last_became_active":"2022-09-17T10:27:42.423848+0000","last_became_peered":"2022-09-17T10:27:42.423848+0000","last_unstale":"2022-09-17T10:27:46.824466+0000","last_undegraded":"2022-09-17T10:27:46.824466+0000","last_fullsized":"2022-09-17T10:27:46.824466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826305+0000","last_change":"2022-09-17T10:27:42.812631+0000","last_active":"2022-09-17T10:27:46.826305+0000","last_peered":"2022-09-17T10:27:46.826305+0000","last_clean":"2022-09-17T10:27:46.826305+0000","last_became_active":"2022-09-17T10:27:42.812131+0000","last_became_peered":"2022-09-17T10:27:42.812131+0000","last_unstale":"2022-09-17T10:27:46.826305+0000","last_undegraded":"2022-09-17T10:27:46.826305+0000","last_fullsized":"2022-09-17T10:27:46.826305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828342+0000","last_change":"2022-09-17T10:27:42.423717+0000","last_active":"2022-09-17T10:27:46.828342+0000","last_peered":"2022-09-17T10:27:46.828342+0000","last_clean":"2022-09-17T10:27:46.828342+0000","last_became_active":"2022-09-17T10:27:42.423419+0000","last_became_peered":"2022-09-17T10:27:42.423419+0000","last_unstale":"2022-09-17T10:27:46.828342+0000","last_undegraded":"2022-09-17T10:27:46.828342+0000","last_fullsized":"2022-09-17T10:27:46.828342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826766+0000","last_change":"2022-09-17T10:27:42.815134+0000","last_active":"2022-09-17T10:27:46.826766+0000","last_peered":"2022-09-17T10:27:46.826766+0000","last_clean":"2022-09-17T10:27:46.826766+0000","last_became_active":"2022-09-17T10:27:42.814787+0000","last_became_peered":"2022-09-17T10:27:42.814787+0000","last_unstale":"2022-09-17T10:27:46.826766+0000","last_undegraded":"2022-09-17T10:27:46.826766+0000","last_fullsized":"2022-09-17T10:27:46.826766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:28:01.975136+0000","last_change":"2022-09-17T10:27:42.420222+0000","last_active":"2022-09-17T10:28:01.975136+0000","last_peered":"2022-09-17T10:28:01.975136+0000","last_clean":"2022-09-17T10:28:01.975136+0000","last_became_active":"2022-09-17T10:27:42.419931+0000","last_became_peered":"2022-09-17T10:27:42.419931+0000","last_unstale":"2022-09-17T10:28:01.975136+0000","last_undegraded":"2022-09-17T10:28:01.975136+0000","last_fullsized":"2022-09-17T10:28:01.975136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3071,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828436+0000","last_change":"2022-09-17T10:27:42.819910+0000","last_active":"2022-09-17T10:27:46.828436+0000","last_peered":"2022-09-17T10:27:46.828436+0000","last_clean":"2022-09-17T10:27:46.828436+0000","last_became_active":"2022-09-17T10:27:42.819746+0000","last_became_peered":"2022-09-17T10:27:42.819746+0000","last_unstale":"2022-09-17T10:27:46.828436+0000","last_undegraded":"2022-09-17T10:27:46.828436+0000","last_fullsized":"2022-09-17T10:27:46.828436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877176+0000","last_change":"2022-09-17T10:27:42.415809+0000","last_active":"2022-09-17T10:27:46.877176+0000","last_peered":"2022-09-17T10:27:46.877176+0000","last_clean":"2022-09-17T10:27:46.877176+0000","last_became_active":"2022-09-17T10:27:42.415484+0000","last_became_peered":"2022-09-17T10:27:42.415484+0000","last_unstale":"2022-09-17T10:27:46.877176+0000","last_undegraded":"2022-09-17T10:27:46.877176+0000","last_fullsized":"2022-09-17T10:27:46.877176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823651+0000","last_change":"2022-09-17T10:27:42.807756+0000","last_active":"2022-09-17T10:27:46.823651+0000","last_peered":"2022-09-17T10:27:46.823651+0000","last_clean":"2022-09-17T10:27:46.823651+0000","last_became_active":"2022-09-17T10:27:42.805782+0000","last_became_peered":"2022-09-17T10:27:42.805782+0000","last_unstale":"2022-09-17T10:27:46.823651+0000","last_undegraded":"2022-09-17T10:27:46.823651+0000","last_fullsized":"2022-09-17T10:27:46.823651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823055+0000","last_change":"2022-09-17T10:27:42.422195+0000","last_active":"2022-09-17T10:27:46.823055+0000","last_peered":"2022-09-17T10:27:46.823055+0000","last_clean":"2022-09-17T10:27:46.823055+0000","last_became_active":"2022-09-17T10:27:42.421922+0000","last_became_peered":"2022-09-17T10:27:42.421922+0000","last_unstale":"2022-09-17T10:27:46.823055+0000","last_undegraded":"2022-09-17T10:27:46.823055+0000","last_fullsized":"2022-09-17T10:27:46.823055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821862+0000","last_change":"2022-09-17T10:27:42.813050+0000","last_active":"2022-09-17T10:27:46.821862+0000","last_peered":"2022-09-17T10:27:46.821862+0000","last_clean":"2022-09-17T10:27:46.821862+0000","last_became_active":"2022-09-17T10:27:42.812770+0000","last_became_peered":"2022-09-17T10:27:42.812770+0000","last_unstale":"2022-09-17T10:27:46.821862+0000","last_undegraded":"2022-09-17T10:27:46.821862+0000","last_fullsized":"2022-09-17T10:27:46.821862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822857+0000","last_change":"2022-09-17T10:27:42.422344+0000","last_active":"2022-09-17T10:27:46.822857+0000","last_peered":"2022-09-17T10:27:46.822857+0000","last_clean":"2022-09-17T10:27:46.822857+0000","last_became_active":"2022-09-17T10:27:42.422015+0000","last_became_peered":"2022-09-17T10:27:42.422015+0000","last_unstale":"2022-09-17T10:27:46.822857+0000","last_undegraded":"2022-09-17T10:27:46.822857+0000","last_fullsized":"2022-09-17T10:27:46.822857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822890+0000","last_change":"2022-09-17T10:27:42.814260+0000","last_active":"2022-09-17T10:27:46.822890+0000","last_peered":"2022-09-17T10:27:46.822890+0000","last_clean":"2022-09-17T10:27:46.822890+0000","last_became_active":"2022-09-17T10:27:42.812936+0000","last_became_peered":"2022-09-17T10:27:42.812936+0000","last_unstale":"2022-09-17T10:27:46.822890+0000","last_undegraded":"2022-09-17T10:27:46.822890+0000","last_fullsized":"2022-09-17T10:27:46.822890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"26'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826690+0000","last_change":"2022-09-17T10:27:42.417825+0000","last_active":"2022-09-17T10:27:46.826690+0000","last_peered":"2022-09-17T10:27:46.826690+0000","last_clean":"2022-09-17T10:27:46.826690+0000","last_became_active":"2022-09-17T10:27:42.417512+0000","last_became_peered":"2022-09-17T10:27:42.417512+0000","last_unstale":"2022-09-17T10:27:46.826690+0000","last_undegraded":"2022-09-17T10:27:46.826690+0000","last_fullsized":"2022-09-17T10:27:46.826690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823543+0000","last_change":"2022-09-17T10:27:42.807539+0000","last_active":"2022-09-17T10:27:46.823543+0000","last_peered":"2022-09-17T10:27:46.823543+0000","last_clean":"2022-09-17T10:27:46.823543+0000","last_became_active":"2022-09-17T10:27:42.807279+0000","last_became_peered":"2022-09-17T10:27:42.807279+0000","last_unstale":"2022-09-17T10:27:46.823543+0000","last_undegraded":"2022-09-17T10:27:46.823543+0000","last_fullsized":"2022-09-17T10:27:46.823543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822418+0000","last_change":"2022-09-17T10:27:42.422307+0000","last_active":"2022-09-17T10:27:46.822418+0000","last_peered":"2022-09-17T10:27:46.822418+0000","last_clean":"2022-09-17T10:27:46.822418+0000","last_became_active":"2022-09-17T10:27:42.421975+0000","last_became_peered":"2022-09-17T10:27:42.421975+0000","last_unstale":"2022-09-17T10:27:46.822418+0000","last_undegraded":"2022-09-17T10:27:46.822418+0000","last_fullsized":"2022-09-17T10:27:46.822418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821707+0000","last_change":"2022-09-17T10:27:42.810271+0000","last_active":"2022-09-17T10:27:46.821707+0000","last_peered":"2022-09-17T10:27:46.821707+0000","last_clean":"2022-09-17T10:27:46.821707+0000","last_became_active":"2022-09-17T10:27:42.809991+0000","last_became_peered":"2022-09-17T10:27:42.809991+0000","last_unstale":"2022-09-17T10:27:46.821707+0000","last_undegraded":"2022-09-17T10:27:46.821707+0000","last_fullsized":"2022-09-17T10:27:46.821707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823546+0000","last_change":"2022-09-17T10:27:42.414343+0000","last_active":"2022-09-17T10:27:46.823546+0000","last_peered":"2022-09-17T10:27:46.823546+0000","last_clean":"2022-09-17T10:27:46.823546+0000","last_became_active":"2022-09-17T10:27:42.413935+0000","last_became_peered":"2022-09-17T10:27:42.413935+0000","last_unstale":"2022-09-17T10:27:46.823546+0000","last_undegraded":"2022-09-17T10:27:46.823546+0000","last_fullsized":"2022-09-17T10:27:46.823546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823831+0000","last_change":"2022-09-17T10:27:42.804945+0000","last_active":"2022-09-17T10:27:46.823831+0000","last_peered":"2022-09-17T10:27:46.823831+0000","last_clean":"2022-09-17T10:27:46.823831+0000","last_became_active":"2022-09-17T10:27:42.804661+0000","last_became_peered":"2022-09-17T10:27:42.804661+0000","last_unstale":"2022-09-17T10:27:46.823831+0000","last_undegraded":"2022-09-17T10:27:46.823831+0000","last_fullsized":"2022-09-17T10:27:46.823831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.278680+0000","last_change":"2022-09-17T10:27:42.423897+0000","last_active":"2022-09-17T10:27:47.278680+0000","last_peered":"2022-09-17T10:27:47.278680+0000","last_clean":"2022-09-17T10:27:47.278680+0000","last_became_active":"2022-09-17T10:27:42.423587+0000","last_became_peered":"2022-09-17T10:27:42.423587+0000","last_unstale":"2022-09-17T10:27:47.278680+0000","last_undegraded":"2022-09-17T10:27:47.278680+0000","last_fullsized":"2022-09-17T10:27:47.278680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821855+0000","last_change":"2022-09-17T10:27:42.814043+0000","last_active":"2022-09-17T10:27:46.821855+0000","last_peered":"2022-09-17T10:27:46.821855+0000","last_clean":"2022-09-17T10:27:46.821855+0000","last_became_active":"2022-09-17T10:27:42.813400+0000","last_became_peered":"2022-09-17T10:27:42.813400+0000","last_unstale":"2022-09-17T10:27:46.821855+0000","last_undegraded":"2022-09-17T10:27:46.821855+0000","last_fullsized":"2022-09-17T10:27:46.821855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821847+0000","last_change":"2022-09-17T10:27:42.420351+0000","last_active":"2022-09-17T10:27:46.821847+0000","last_peered":"2022-09-17T10:27:46.821847+0000","last_clean":"2022-09-17T10:27:46.821847+0000","last_became_active":"2022-09-17T10:27:42.420099+0000","last_became_peered":"2022-09-17T10:27:42.420099+0000","last_unstale":"2022-09-17T10:27:46.821847+0000","last_undegraded":"2022-09-17T10:27:46.821847+0000","last_fullsized":"2022-09-17T10:27:46.821847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823380+0000","last_change":"2022-09-17T10:27:42.809309+0000","last_active":"2022-09-17T10:27:46.823380+0000","last_peered":"2022-09-17T10:27:46.823380+0000","last_clean":"2022-09-17T10:27:46.823380+0000","last_became_active":"2022-09-17T10:27:42.809010+0000","last_became_peered":"2022-09-17T10:27:42.809010+0000","last_unstale":"2022-09-17T10:27:46.823380+0000","last_undegraded":"2022-09-17T10:27:46.823380+0000","last_fullsized":"2022-09-17T10:27:46.823380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877081+0000","last_change":"2022-09-17T10:27:42.420420+0000","last_active":"2022-09-17T10:27:46.877081+0000","last_peered":"2022-09-17T10:27:46.877081+0000","last_clean":"2022-09-17T10:27:46.877081+0000","last_became_active":"2022-09-17T10:27:42.420111+0000","last_became_peered":"2022-09-17T10:27:42.420111+0000","last_unstale":"2022-09-17T10:27:46.877081+0000","last_undegraded":"2022-09-17T10:27:46.877081+0000","last_fullsized":"2022-09-17T10:27:46.877081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828081+0000","last_change":"2022-09-17T10:27:42.813626+0000","last_active":"2022-09-17T10:27:46.828081+0000","last_peered":"2022-09-17T10:27:46.828081+0000","last_clean":"2022-09-17T10:27:46.828081+0000","last_became_active":"2022-09-17T10:27:42.813315+0000","last_became_peered":"2022-09-17T10:27:42.813315+0000","last_unstale":"2022-09-17T10:27:46.828081+0000","last_undegraded":"2022-09-17T10:27:46.828081+0000","last_fullsized":"2022-09-17T10:27:46.828081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828974+0000","last_change":"2022-09-17T10:27:42.418323+0000","last_active":"2022-09-17T10:27:46.828974+0000","last_peered":"2022-09-17T10:27:46.828974+0000","last_clean":"2022-09-17T10:27:46.828974+0000","last_became_active":"2022-09-17T10:27:42.417741+0000","last_became_peered":"2022-09-17T10:27:42.417741+0000","last_unstale":"2022-09-17T10:27:46.828974+0000","last_undegraded":"2022-09-17T10:27:46.828974+0000","last_fullsized":"2022-09-17T10:27:46.828974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877907+0000","last_change":"2022-09-17T10:27:42.815309+0000","last_active":"2022-09-17T10:27:46.877907+0000","last_peered":"2022-09-17T10:27:46.877907+0000","last_clean":"2022-09-17T10:27:46.877907+0000","last_became_active":"2022-09-17T10:27:42.815017+0000","last_became_peered":"2022-09-17T10:27:42.815017+0000","last_unstale":"2022-09-17T10:27:46.877907+0000","last_undegraded":"2022-09-17T10:27:46.877907+0000","last_fullsized":"2022-09-17T10:27:46.877907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831220+0000","last_change":"2022-09-17T10:27:42.426225+0000","last_active":"2022-09-17T10:27:46.831220+0000","last_peered":"2022-09-17T10:27:46.831220+0000","last_clean":"2022-09-17T10:27:46.831220+0000","last_became_active":"2022-09-17T10:27:42.425653+0000","last_became_peered":"2022-09-17T10:27:42.425653+0000","last_unstale":"2022-09-17T10:27:46.831220+0000","last_undegraded":"2022-09-17T10:27:46.831220+0000","last_fullsized":"2022-09-17T10:27:46.831220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823944+0000","last_change":"2022-09-17T10:27:42.811093+0000","last_active":"2022-09-17T10:27:46.823944+0000","last_peered":"2022-09-17T10:27:46.823944+0000","last_clean":"2022-09-17T10:27:46.823944+0000","last_became_active":"2022-09-17T10:27:42.810788+0000","last_became_peered":"2022-09-17T10:27:42.810788+0000","last_unstale":"2022-09-17T10:27:46.823944+0000","last_undegraded":"2022-09-17T10:27:46.823944+0000","last_fullsized":"2022-09-17T10:27:46.823944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826854+0000","last_change":"2022-09-17T10:27:42.418052+0000","last_active":"2022-09-17T10:27:46.826854+0000","last_peered":"2022-09-17T10:27:46.826854+0000","last_clean":"2022-09-17T10:27:46.826854+0000","last_became_active":"2022-09-17T10:27:42.417695+0000","last_became_peered":"2022-09-17T10:27:42.417695+0000","last_unstale":"2022-09-17T10:27:46.826854+0000","last_undegraded":"2022-09-17T10:27:46.826854+0000","last_fullsized":"2022-09-17T10:27:46.826854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823676+0000","last_change":"2022-09-17T10:27:42.816896+0000","last_active":"2022-09-17T10:27:46.823676+0000","last_peered":"2022-09-17T10:27:46.823676+0000","last_clean":"2022-09-17T10:27:46.823676+0000","last_became_active":"2022-09-17T10:27:42.816607+0000","last_became_peered":"2022-09-17T10:27:42.816607+0000","last_unstale":"2022-09-17T10:27:46.823676+0000","last_undegraded":"2022-09-17T10:27:46.823676+0000","last_fullsized":"2022-09-17T10:27:46.823676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831328+0000","last_change":"2022-09-17T10:27:42.421839+0000","last_active":"2022-09-17T10:27:46.831328+0000","last_peered":"2022-09-17T10:27:46.831328+0000","last_clean":"2022-09-17T10:27:46.831328+0000","last_became_active":"2022-09-17T10:27:42.421558+0000","last_became_peered":"2022-09-17T10:27:42.421558+0000","last_unstale":"2022-09-17T10:27:46.831328+0000","last_undegraded":"2022-09-17T10:27:46.831328+0000","last_fullsized":"2022-09-17T10:27:46.831328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822971+0000","last_change":"2022-09-17T10:27:42.812667+0000","last_active":"2022-09-17T10:27:46.822971+0000","last_peered":"2022-09-17T10:27:46.822971+0000","last_clean":"2022-09-17T10:27:46.822971+0000","last_became_active":"2022-09-17T10:27:42.812360+0000","last_became_peered":"2022-09-17T10:27:42.812360+0000","last_unstale":"2022-09-17T10:27:46.822971+0000","last_undegraded":"2022-09-17T10:27:46.822971+0000","last_fullsized":"2022-09-17T10:27:46.822971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.278681+0000","last_change":"2022-09-17T10:27:42.418422+0000","last_active":"2022-09-17T10:27:47.278681+0000","last_peered":"2022-09-17T10:27:47.278681+0000","last_clean":"2022-09-17T10:27:47.278681+0000","last_became_active":"2022-09-17T10:27:42.418158+0000","last_became_peered":"2022-09-17T10:27:42.418158+0000","last_unstale":"2022-09-17T10:27:47.278681+0000","last_undegraded":"2022-09-17T10:27:47.278681+0000","last_fullsized":"2022-09-17T10:27:47.278681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876897+0000","last_change":"2022-09-17T10:27:42.816353+0000","last_active":"2022-09-17T10:27:46.876897+0000","last_peered":"2022-09-17T10:27:46.876897+0000","last_clean":"2022-09-17T10:27:46.876897+0000","last_became_active":"2022-09-17T10:27:42.816143+0000","last_became_peered":"2022-09-17T10:27:42.816143+0000","last_unstale":"2022-09-17T10:27:46.876897+0000","last_undegraded":"2022-09-17T10:27:46.876897+0000","last_fullsized":"2022-09-17T10:27:46.876897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822690+0000","last_change":"2022-09-17T10:27:42.415503+0000","last_active":"2022-09-17T10:27:46.822690+0000","last_peered":"2022-09-17T10:27:46.822690+0000","last_clean":"2022-09-17T10:27:46.822690+0000","last_became_active":"2022-09-17T10:27:42.415203+0000","last_became_peered":"2022-09-17T10:27:42.415203+0000","last_unstale":"2022-09-17T10:27:46.822690+0000","last_undegraded":"2022-09-17T10:27:46.822690+0000","last_fullsized":"2022-09-17T10:27:46.822690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821740+0000","last_change":"2022-09-17T10:27:42.814233+0000","last_active":"2022-09-17T10:27:46.821740+0000","last_peered":"2022-09-17T10:27:46.821740+0000","last_clean":"2022-09-17T10:27:46.821740+0000","last_became_active":"2022-09-17T10:27:42.813735+0000","last_became_peered":"2022-09-17T10:27:42.813735+0000","last_unstale":"2022-09-17T10:27:46.821740+0000","last_undegraded":"2022-09-17T10:27:46.821740+0000","last_fullsized":"2022-09-17T10:27:46.821740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877411+0000","last_change":"2022-09-17T10:27:42.420755+0000","last_active":"2022-09-17T10:27:46.877411+0000","last_peered":"2022-09-17T10:27:46.877411+0000","last_clean":"2022-09-17T10:27:46.877411+0000","last_became_active":"2022-09-17T10:27:42.420413+0000","last_became_peered":"2022-09-17T10:27:42.420413+0000","last_unstale":"2022-09-17T10:27:46.877411+0000","last_undegraded":"2022-09-17T10:27:46.877411+0000","last_fullsized":"2022-09-17T10:27:46.877411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831001+0000","last_change":"2022-09-17T10:27:42.818083+0000","last_active":"2022-09-17T10:27:46.831001+0000","last_peered":"2022-09-17T10:27:46.831001+0000","last_clean":"2022-09-17T10:27:46.831001+0000","last_became_active":"2022-09-17T10:27:42.817877+0000","last_became_peered":"2022-09-17T10:27:42.817877+0000","last_unstale":"2022-09-17T10:27:46.831001+0000","last_undegraded":"2022-09-17T10:27:46.831001+0000","last_fullsized":"2022-09-17T10:27:46.831001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824985+0000","last_change":"2022-09-17T10:27:42.419616+0000","last_active":"2022-09-17T10:27:46.824985+0000","last_peered":"2022-09-17T10:27:46.824985+0000","last_clean":"2022-09-17T10:27:46.824985+0000","last_became_active":"2022-09-17T10:27:42.419310+0000","last_became_peered":"2022-09-17T10:27:42.419310+0000","last_unstale":"2022-09-17T10:27:46.824985+0000","last_undegraded":"2022-09-17T10:27:46.824985+0000","last_fullsized":"2022-09-17T10:27:46.824985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825681+0000","last_change":"2022-09-17T10:27:42.817667+0000","last_active":"2022-09-17T10:27:46.825681+0000","last_peered":"2022-09-17T10:27:46.825681+0000","last_clean":"2022-09-17T10:27:46.825681+0000","last_became_active":"2022-09-17T10:27:42.817320+0000","last_became_peered":"2022-09-17T10:27:42.817320+0000","last_unstale":"2022-09-17T10:27:46.825681+0000","last_undegraded":"2022-09-17T10:27:46.825681+0000","last_fullsized":"2022-09-17T10:27:46.825681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824135+0000","last_change":"2022-09-17T10:27:42.423348+0000","last_active":"2022-09-17T10:27:46.824135+0000","last_peered":"2022-09-17T10:27:46.824135+0000","last_clean":"2022-09-17T10:27:46.824135+0000","last_became_active":"2022-09-17T10:27:42.423040+0000","last_became_peered":"2022-09-17T10:27:42.423040+0000","last_unstale":"2022-09-17T10:27:46.824135+0000","last_undegraded":"2022-09-17T10:27:46.824135+0000","last_fullsized":"2022-09-17T10:27:46.824135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822997+0000","last_change":"2022-09-17T10:27:42.808072+0000","last_active":"2022-09-17T10:27:46.822997+0000","last_peered":"2022-09-17T10:27:46.822997+0000","last_clean":"2022-09-17T10:27:46.822997+0000","last_became_active":"2022-09-17T10:27:42.807765+0000","last_became_peered":"2022-09-17T10:27:42.807765+0000","last_unstale":"2022-09-17T10:27:46.822997+0000","last_undegraded":"2022-09-17T10:27:46.822997+0000","last_fullsized":"2022-09-17T10:27:46.822997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823608+0000","last_change":"2022-09-17T10:27:42.417146+0000","last_active":"2022-09-17T10:27:46.823608+0000","last_peered":"2022-09-17T10:27:46.823608+0000","last_clean":"2022-09-17T10:27:46.823608+0000","last_became_active":"2022-09-17T10:27:42.416444+0000","last_became_peered":"2022-09-17T10:27:42.416444+0000","last_unstale":"2022-09-17T10:27:46.823608+0000","last_undegraded":"2022-09-17T10:27:46.823608+0000","last_fullsized":"2022-09-17T10:27:46.823608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879652+0000","last_change":"2022-09-17T10:27:42.808199+0000","last_active":"2022-09-17T10:27:46.879652+0000","last_peered":"2022-09-17T10:27:46.879652+0000","last_clean":"2022-09-17T10:27:46.879652+0000","last_became_active":"2022-09-17T10:27:42.807904+0000","last_became_peered":"2022-09-17T10:27:42.807904+0000","last_unstale":"2022-09-17T10:27:46.879652+0000","last_undegraded":"2022-09-17T10:27:46.879652+0000","last_fullsized":"2022-09-17T10:27:46.879652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821818+0000","last_change":"2022-09-17T10:27:42.419293+0000","last_active":"2022-09-17T10:27:46.821818+0000","last_peered":"2022-09-17T10:27:46.821818+0000","last_clean":"2022-09-17T10:27:46.821818+0000","last_became_active":"2022-09-17T10:27:42.419016+0000","last_became_peered":"2022-09-17T10:27:42.419016+0000","last_unstale":"2022-09-17T10:27:46.821818+0000","last_undegraded":"2022-09-17T10:27:46.821818+0000","last_fullsized":"2022-09-17T10:27:46.821818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823777+0000","last_change":"2022-09-17T10:27:42.811222+0000","last_active":"2022-09-17T10:27:46.823777+0000","last_peered":"2022-09-17T10:27:46.823777+0000","last_clean":"2022-09-17T10:27:46.823777+0000","last_became_active":"2022-09-17T10:27:42.810431+0000","last_became_peered":"2022-09-17T10:27:42.810431+0000","last_unstale":"2022-09-17T10:27:46.823777+0000","last_undegraded":"2022-09-17T10:27:46.823777+0000","last_fullsized":"2022-09-17T10:27:46.823777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"26'1","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824396+0000","last_change":"2022-09-17T10:27:42.418764+0000","last_active":"2022-09-17T10:27:46.824396+0000","last_peered":"2022-09-17T10:27:46.824396+0000","last_clean":"2022-09-17T10:27:46.824396+0000","last_became_active":"2022-09-17T10:27:42.418460+0000","last_became_peered":"2022-09-17T10:27:42.418460+0000","last_unstale":"2022-09-17T10:27:46.824396+0000","last_undegraded":"2022-09-17T10:27:46.824396+0000","last_fullsized":"2022-09-17T10:27:46.824396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820837+0000","last_change":"2022-09-17T10:27:42.811297+0000","last_active":"2022-09-17T10:27:46.820837+0000","last_peered":"2022-09-17T10:27:46.820837+0000","last_clean":"2022-09-17T10:27:46.820837+0000","last_became_active":"2022-09-17T10:27:42.810563+0000","last_became_peered":"2022-09-17T10:27:42.810563+0000","last_unstale":"2022-09-17T10:27:46.820837+0000","last_undegraded":"2022-09-17T10:27:46.820837+0000","last_fullsized":"2022-09-17T10:27:46.820837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.881583+0000","last_change":"2022-09-17T10:27:46.879898+0000","last_active":"2022-09-17T10:27:46.881583+0000","last_peered":"2022-09-17T10:27:46.881583+0000","last_clean":"2022-09-17T10:27:46.881583+0000","last_became_active":"2022-09-17T10:27:46.877842+0000","last_became_peered":"2022-09-17T10:27:46.877842+0000","last_unstale":"2022-09-17T10:27:46.881583+0000","last_undegraded":"2022-09-17T10:27:46.881583+0000","last_fullsized":"2022-09-17T10:27:46.881583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831170+0000","last_change":"2022-09-17T10:27:42.426206+0000","last_active":"2022-09-17T10:27:46.831170+0000","last_peered":"2022-09-17T10:27:46.831170+0000","last_clean":"2022-09-17T10:27:46.831170+0000","last_became_active":"2022-09-17T10:27:42.425534+0000","last_became_peered":"2022-09-17T10:27:42.425534+0000","last_unstale":"2022-09-17T10:27:46.831170+0000","last_undegraded":"2022-09-17T10:27:46.831170+0000","last_fullsized":"2022-09-17T10:27:46.831170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823594+0000","last_change":"2022-09-17T10:27:42.805131+0000","last_active":"2022-09-17T10:27:46.823594+0000","last_peered":"2022-09-17T10:27:46.823594+0000","last_clean":"2022-09-17T10:27:46.823594+0000","last_became_active":"2022-09-17T10:27:42.804846+0000","last_became_peered":"2022-09-17T10:27:42.804846+0000","last_unstale":"2022-09-17T10:27:46.823594+0000","last_undegraded":"2022-09-17T10:27:46.823594+0000","last_fullsized":"2022-09-17T10:27:46.823594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838709+0000","last_change":"2022-09-17T10:27:46.833771+0000","last_active":"2022-09-17T10:27:46.838709+0000","last_peered":"2022-09-17T10:27:46.838709+0000","last_clean":"2022-09-17T10:27:46.838709+0000","last_became_active":"2022-09-17T10:27:46.833345+0000","last_became_peered":"2022-09-17T10:27:46.833345+0000","last_unstale":"2022-09-17T10:27:46.838709+0000","last_undegraded":"2022-09-17T10:27:46.838709+0000","last_fullsized":"2022-09-17T10:27:46.838709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826554+0000","last_change":"2022-09-17T10:27:42.422308+0000","last_active":"2022-09-17T10:27:46.826554+0000","last_peered":"2022-09-17T10:27:46.826554+0000","last_clean":"2022-09-17T10:27:46.826554+0000","last_became_active":"2022-09-17T10:27:42.422019+0000","last_became_peered":"2022-09-17T10:27:42.422019+0000","last_unstale":"2022-09-17T10:27:46.826554+0000","last_undegraded":"2022-09-17T10:27:46.826554+0000","last_fullsized":"2022-09-17T10:27:46.826554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821083+0000","last_change":"2022-09-17T10:27:42.810397+0000","last_active":"2022-09-17T10:27:46.821083+0000","last_peered":"2022-09-17T10:27:46.821083+0000","last_clean":"2022-09-17T10:27:46.821083+0000","last_became_active":"2022-09-17T10:27:42.810076+0000","last_became_peered":"2022-09-17T10:27:42.810076+0000","last_unstale":"2022-09-17T10:27:46.821083+0000","last_undegraded":"2022-09-17T10:27:46.821083+0000","last_fullsized":"2022-09-17T10:27:46.821083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839292+0000","last_change":"2022-09-17T10:27:46.836157+0000","last_active":"2022-09-17T10:27:46.839292+0000","last_peered":"2022-09-17T10:27:46.839292+0000","last_clean":"2022-09-17T10:27:46.839292+0000","last_became_active":"2022-09-17T10:27:46.835717+0000","last_became_peered":"2022-09-17T10:27:46.835717+0000","last_unstale":"2022-09-17T10:27:46.839292+0000","last_undegraded":"2022-09-17T10:27:46.839292+0000","last_fullsized":"2022-09-17T10:27:46.839292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827850+0000","last_change":"2022-09-17T10:27:42.414705+0000","last_active":"2022-09-17T10:27:46.827850+0000","last_peered":"2022-09-17T10:27:46.827850+0000","last_clean":"2022-09-17T10:27:46.827850+0000","last_became_active":"2022-09-17T10:27:42.414385+0000","last_became_peered":"2022-09-17T10:27:42.414385+0000","last_unstale":"2022-09-17T10:27:46.827850+0000","last_undegraded":"2022-09-17T10:27:46.827850+0000","last_fullsized":"2022-09-17T10:27:46.827850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820968+0000","last_change":"2022-09-17T10:27:42.817114+0000","last_active":"2022-09-17T10:27:46.820968+0000","last_peered":"2022-09-17T10:27:46.820968+0000","last_clean":"2022-09-17T10:27:46.820968+0000","last_became_active":"2022-09-17T10:27:42.816803+0000","last_became_peered":"2022-09-17T10:27:42.816803+0000","last_unstale":"2022-09-17T10:27:46.820968+0000","last_undegraded":"2022-09-17T10:27:46.820968+0000","last_fullsized":"2022-09-17T10:27:46.820968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879975+0000","last_change":"2022-09-17T10:27:46.878852+0000","last_active":"2022-09-17T10:27:46.879975+0000","last_peered":"2022-09-17T10:27:46.879975+0000","last_clean":"2022-09-17T10:27:46.879975+0000","last_became_active":"2022-09-17T10:27:46.878402+0000","last_became_peered":"2022-09-17T10:27:46.878402+0000","last_unstale":"2022-09-17T10:27:46.879975+0000","last_undegraded":"2022-09-17T10:27:46.879975+0000","last_fullsized":"2022-09-17T10:27:46.879975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.882394+0000","last_change":"2022-09-17T10:27:46.880930+0000","last_active":"2022-09-17T10:27:46.882394+0000","last_peered":"2022-09-17T10:27:46.882394+0000","last_clean":"2022-09-17T10:27:46.882394+0000","last_became_active":"2022-09-17T10:27:46.880498+0000","last_became_peered":"2022-09-17T10:27:46.880498+0000","last_unstale":"2022-09-17T10:27:46.882394+0000","last_undegraded":"2022-09-17T10:27:46.882394+0000","last_fullsized":"2022-09-17T10:27:46.882394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828368+0000","last_change":"2022-09-17T10:27:42.422458+0000","last_active":"2022-09-17T10:27:46.828368+0000","last_peered":"2022-09-17T10:27:46.828368+0000","last_clean":"2022-09-17T10:27:46.828368+0000","last_became_active":"2022-09-17T10:27:42.422187+0000","last_became_peered":"2022-09-17T10:27:42.422187+0000","last_unstale":"2022-09-17T10:27:46.828368+0000","last_undegraded":"2022-09-17T10:27:46.828368+0000","last_fullsized":"2022-09-17T10:27:46.828368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825686+0000","last_change":"2022-09-17T10:27:42.806970+0000","last_active":"2022-09-17T10:27:46.825686+0000","last_peered":"2022-09-17T10:27:46.825686+0000","last_clean":"2022-09-17T10:27:46.825686+0000","last_became_active":"2022-09-17T10:27:42.806322+0000","last_became_peered":"2022-09-17T10:27:42.806322+0000","last_unstale":"2022-09-17T10:27:46.825686+0000","last_undegraded":"2022-09-17T10:27:46.825686+0000","last_fullsized":"2022-09-17T10:27:46.825686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823713+0000","last_change":"2022-09-17T10:27:42.812236+0000","last_active":"2022-09-17T10:27:46.823713+0000","last_peered":"2022-09-17T10:27:46.823713+0000","last_clean":"2022-09-17T10:27:46.823713+0000","last_became_active":"2022-09-17T10:27:42.811869+0000","last_became_peered":"2022-09-17T10:27:42.811869+0000","last_unstale":"2022-09-17T10:27:46.823713+0000","last_undegraded":"2022-09-17T10:27:46.823713+0000","last_fullsized":"2022-09-17T10:27:46.823713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823142+0000","last_change":"2022-09-17T10:27:42.423679+0000","last_active":"2022-09-17T10:27:46.823142+0000","last_peered":"2022-09-17T10:27:46.823142+0000","last_clean":"2022-09-17T10:27:46.823142+0000","last_became_active":"2022-09-17T10:27:42.423382+0000","last_became_peered":"2022-09-17T10:27:42.423382+0000","last_unstale":"2022-09-17T10:27:46.823142+0000","last_undegraded":"2022-09-17T10:27:46.823142+0000","last_fullsized":"2022-09-17T10:27:46.823142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821044+0000","last_change":"2022-09-17T10:27:37.393333+0000","last_active":"2022-09-17T10:27:46.821044+0000","last_peered":"2022-09-17T10:27:46.821044+0000","last_clean":"2022-09-17T10:27:46.821044+0000","last_became_active":"2022-09-17T10:27:37.393020+0000","last_became_peered":"2022-09-17T10:27:37.393020+0000","last_unstale":"2022-09-17T10:27:46.821044+0000","last_undegraded":"2022-09-17T10:27:46.821044+0000","last_fullsized":"2022-09-17T10:27:46.821044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.836043+0000","last_change":"2022-09-17T10:27:46.833138+0000","last_active":"2022-09-17T10:27:46.836043+0000","last_peered":"2022-09-17T10:27:46.836043+0000","last_clean":"2022-09-17T10:27:46.836043+0000","last_became_active":"2022-09-17T10:27:46.832732+0000","last_became_peered":"2022-09-17T10:27:46.832732+0000","last_unstale":"2022-09-17T10:27:46.836043+0000","last_undegraded":"2022-09-17T10:27:46.836043+0000","last_fullsized":"2022-09-17T10:27:46.836043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830521+0000","last_change":"2022-09-17T10:27:42.808357+0000","last_active":"2022-09-17T10:27:46.830521+0000","last_peered":"2022-09-17T10:27:46.830521+0000","last_clean":"2022-09-17T10:27:46.830521+0000","last_became_active":"2022-09-17T10:27:42.808087+0000","last_became_peered":"2022-09-17T10:27:42.808087+0000","last_unstale":"2022-09-17T10:27:46.830521+0000","last_undegraded":"2022-09-17T10:27:46.830521+0000","last_fullsized":"2022-09-17T10:27:46.830521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823635+0000","last_change":"2022-09-17T10:27:37.394630+0000","last_active":"2022-09-17T10:27:46.823635+0000","last_peered":"2022-09-17T10:27:46.823635+0000","last_clean":"2022-09-17T10:27:46.823635+0000","last_became_active":"2022-09-17T10:27:37.394313+0000","last_became_peered":"2022-09-17T10:27:37.394313+0000","last_unstale":"2022-09-17T10:27:46.823635+0000","last_undegraded":"2022-09-17T10:27:46.823635+0000","last_fullsized":"2022-09-17T10:27:46.823635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831821+0000","last_change":"2022-09-17T10:27:42.423502+0000","last_active":"2022-09-17T10:27:46.831821+0000","last_peered":"2022-09-17T10:27:46.831821+0000","last_clean":"2022-09-17T10:27:46.831821+0000","last_became_active":"2022-09-17T10:27:42.423217+0000","last_became_peered":"2022-09-17T10:27:42.423217+0000","last_unstale":"2022-09-17T10:27:46.831821+0000","last_undegraded":"2022-09-17T10:27:46.831821+0000","last_fullsized":"2022-09-17T10:27:46.831821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839878+0000","last_change":"2022-09-17T10:27:46.837673+0000","last_active":"2022-09-17T10:27:46.839878+0000","last_peered":"2022-09-17T10:27:46.839878+0000","last_clean":"2022-09-17T10:27:46.839878+0000","last_became_active":"2022-09-17T10:27:46.837297+0000","last_became_peered":"2022-09-17T10:27:46.837297+0000","last_unstale":"2022-09-17T10:27:46.839878+0000","last_undegraded":"2022-09-17T10:27:46.839878+0000","last_fullsized":"2022-09-17T10:27:46.839878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821835+0000","last_change":"2022-09-17T10:27:42.817158+0000","last_active":"2022-09-17T10:27:46.821835+0000","last_peered":"2022-09-17T10:27:46.821835+0000","last_clean":"2022-09-17T10:27:46.821835+0000","last_became_active":"2022-09-17T10:27:42.816865+0000","last_became_peered":"2022-09-17T10:27:42.816865+0000","last_unstale":"2022-09-17T10:27:46.821835+0000","last_undegraded":"2022-09-17T10:27:46.821835+0000","last_fullsized":"2022-09-17T10:27:46.821835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877323+0000","last_change":"2022-09-17T10:27:42.420110+0000","last_active":"2022-09-17T10:27:46.877323+0000","last_peered":"2022-09-17T10:27:46.877323+0000","last_clean":"2022-09-17T10:27:46.877323+0000","last_became_active":"2022-09-17T10:27:42.419792+0000","last_became_peered":"2022-09-17T10:27:42.419792+0000","last_unstale":"2022-09-17T10:27:46.877323+0000","last_undegraded":"2022-09-17T10:27:46.877323+0000","last_fullsized":"2022-09-17T10:27:46.877323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832869+0000","last_change":"2022-09-17T10:27:37.518568+0000","last_active":"2022-09-17T10:27:46.832869+0000","last_peered":"2022-09-17T10:27:46.832869+0000","last_clean":"2022-09-17T10:27:46.832869+0000","last_became_active":"2022-09-17T10:27:37.518118+0000","last_became_peered":"2022-09-17T10:27:37.518118+0000","last_unstale":"2022-09-17T10:27:46.832869+0000","last_undegraded":"2022-09-17T10:27:46.832869+0000","last_fullsized":"2022-09-17T10:27:46.832869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.834941+0000","last_change":"2022-09-17T10:27:46.830735+0000","last_active":"2022-09-17T10:27:46.834941+0000","last_peered":"2022-09-17T10:27:46.834941+0000","last_clean":"2022-09-17T10:27:46.834941+0000","last_became_active":"2022-09-17T10:27:46.830221+0000","last_became_peered":"2022-09-17T10:27:46.830221+0000","last_unstale":"2022-09-17T10:27:46.834941+0000","last_undegraded":"2022-09-17T10:27:46.834941+0000","last_fullsized":"2022-09-17T10:27:46.834941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876839+0000","last_change":"2022-09-17T10:27:42.417099+0000","last_active":"2022-09-17T10:27:46.876839+0000","last_peered":"2022-09-17T10:27:46.876839+0000","last_clean":"2022-09-17T10:27:46.876839+0000","last_became_active":"2022-09-17T10:27:42.416817+0000","last_became_peered":"2022-09-17T10:27:42.416817+0000","last_unstale":"2022-09-17T10:27:46.876839+0000","last_undegraded":"2022-09-17T10:27:46.876839+0000","last_fullsized":"2022-09-17T10:27:46.876839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831235+0000","last_change":"2022-09-17T10:27:37.519776+0000","last_active":"2022-09-17T10:27:46.831235+0000","last_peered":"2022-09-17T10:27:46.831235+0000","last_clean":"2022-09-17T10:27:46.831235+0000","last_became_active":"2022-09-17T10:27:37.519419+0000","last_became_peered":"2022-09-17T10:27:37.519419+0000","last_unstale":"2022-09-17T10:27:46.831235+0000","last_undegraded":"2022-09-17T10:27:46.831235+0000","last_fullsized":"2022-09-17T10:27:46.831235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826040+0000","last_change":"2022-09-17T10:27:42.818131+0000","last_active":"2022-09-17T10:27:46.826040+0000","last_peered":"2022-09-17T10:27:46.826040+0000","last_clean":"2022-09-17T10:27:46.826040+0000","last_became_active":"2022-09-17T10:27:42.817852+0000","last_became_peered":"2022-09-17T10:27:42.817852+0000","last_unstale":"2022-09-17T10:27:46.826040+0000","last_undegraded":"2022-09-17T10:27:46.826040+0000","last_fullsized":"2022-09-17T10:27:46.826040+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838321+0000","last_change":"2022-09-17T10:27:46.836570+0000","last_active":"2022-09-17T10:27:46.838321+0000","last_peered":"2022-09-17T10:27:46.838321+0000","last_clean":"2022-09-17T10:27:46.838321+0000","last_became_active":"2022-09-17T10:27:46.836058+0000","last_became_peered":"2022-09-17T10:27:46.836058+0000","last_unstale":"2022-09-17T10:27:46.838321+0000","last_undegraded":"2022-09-17T10:27:46.838321+0000","last_fullsized":"2022-09-17T10:27:46.838321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831209+0000","last_change":"2022-09-17T10:27:42.421065+0000","last_active":"2022-09-17T10:27:46.831209+0000","last_peered":"2022-09-17T10:27:46.831209+0000","last_clean":"2022-09-17T10:27:46.831209+0000","last_became_active":"2022-09-17T10:27:42.420726+0000","last_became_peered":"2022-09-17T10:27:42.420726+0000","last_unstale":"2022-09-17T10:27:46.831209+0000","last_undegraded":"2022-09-17T10:27:46.831209+0000","last_fullsized":"2022-09-17T10:27:46.831209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826418+0000","last_change":"2022-09-17T10:27:34.683645+0000","last_active":"2022-09-17T10:27:46.826418+0000","last_peered":"2022-09-17T10:27:46.826418+0000","last_clean":"2022-09-17T10:27:46.826418+0000","last_became_active":"2022-09-17T10:27:34.683343+0000","last_became_peered":"2022-09-17T10:27:34.683343+0000","last_unstale":"2022-09-17T10:27:46.826418+0000","last_undegraded":"2022-09-17T10:27:46.826418+0000","last_fullsized":"2022-09-17T10:27:46.826418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:33.351685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:33.351685+0000","last_clean_scrub_stamp":"2022-09-17T10:27:33.351685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.820922+0000","last_change":"2022-09-17T10:27:37.392686+0000","last_active":"2022-09-17T10:27:46.820922+0000","last_peered":"2022-09-17T10:27:46.820922+0000","last_clean":"2022-09-17T10:27:46.820922+0000","last_became_active":"2022-09-17T10:27:37.392465+0000","last_became_peered":"2022-09-17T10:27:37.392465+0000","last_unstale":"2022-09-17T10:27:46.820922+0000","last_undegraded":"2022-09-17T10:27:46.820922+0000","last_fullsized":"2022-09-17T10:27:46.820922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828213+0000","last_change":"2022-09-17T10:27:42.817727+0000","last_active":"2022-09-17T10:27:46.828213+0000","last_peered":"2022-09-17T10:27:46.828213+0000","last_clean":"2022-09-17T10:27:46.828213+0000","last_became_active":"2022-09-17T10:27:42.817394+0000","last_became_peered":"2022-09-17T10:27:42.817394+0000","last_unstale":"2022-09-17T10:27:46.828213+0000","last_undegraded":"2022-09-17T10:27:46.828213+0000","last_fullsized":"2022-09-17T10:27:46.828213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879456+0000","last_change":"2022-09-17T10:27:46.878670+0000","last_active":"2022-09-17T10:27:46.879456+0000","last_peered":"2022-09-17T10:27:46.879456+0000","last_clean":"2022-09-17T10:27:46.879456+0000","last_became_active":"2022-09-17T10:27:46.878229+0000","last_became_peered":"2022-09-17T10:27:46.878229+0000","last_unstale":"2022-09-17T10:27:46.879456+0000","last_undegraded":"2022-09-17T10:27:46.879456+0000","last_fullsized":"2022-09-17T10:27:46.879456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826285+0000","last_change":"2022-09-17T10:27:42.419675+0000","last_active":"2022-09-17T10:27:46.826285+0000","last_peered":"2022-09-17T10:27:46.826285+0000","last_clean":"2022-09-17T10:27:46.826285+0000","last_became_active":"2022-09-17T10:27:42.419276+0000","last_became_peered":"2022-09-17T10:27:42.419276+0000","last_unstale":"2022-09-17T10:27:46.826285+0000","last_undegraded":"2022-09-17T10:27:46.826285+0000","last_fullsized":"2022-09-17T10:27:46.826285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.876695+0000","last_change":"2022-09-17T10:27:37.518223+0000","last_active":"2022-09-17T10:27:46.876695+0000","last_peered":"2022-09-17T10:27:46.876695+0000","last_clean":"2022-09-17T10:27:46.876695+0000","last_became_active":"2022-09-17T10:27:37.517883+0000","last_became_peered":"2022-09-17T10:27:37.517883+0000","last_unstale":"2022-09-17T10:27:46.876695+0000","last_undegraded":"2022-09-17T10:27:46.876695+0000","last_fullsized":"2022-09-17T10:27:46.876695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.878284+0000","last_change":"2022-09-17T10:27:42.817484+0000","last_active":"2022-09-17T10:27:46.878284+0000","last_peered":"2022-09-17T10:27:46.878284+0000","last_clean":"2022-09-17T10:27:46.878284+0000","last_became_active":"2022-09-17T10:27:42.817192+0000","last_became_peered":"2022-09-17T10:27:42.817192+0000","last_unstale":"2022-09-17T10:27:46.878284+0000","last_undegraded":"2022-09-17T10:27:46.878284+0000","last_fullsized":"2022-09-17T10:27:46.878284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879275+0000","last_change":"2022-09-17T10:27:46.878284+0000","last_active":"2022-09-17T10:27:46.879275+0000","last_peered":"2022-09-17T10:27:46.879275+0000","last_clean":"2022-09-17T10:27:46.879275+0000","last_became_active":"2022-09-17T10:27:46.877826+0000","last_became_peered":"2022-09-17T10:27:46.877826+0000","last_unstale":"2022-09-17T10:27:46.879275+0000","last_undegraded":"2022-09-17T10:27:46.879275+0000","last_fullsized":"2022-09-17T10:27:46.879275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877241+0000","last_change":"2022-09-17T10:27:42.805395+0000","last_active":"2022-09-17T10:27:46.877241+0000","last_peered":"2022-09-17T10:27:46.877241+0000","last_clean":"2022-09-17T10:27:46.877241+0000","last_became_active":"2022-09-17T10:27:42.805072+0000","last_became_peered":"2022-09-17T10:27:42.805072+0000","last_unstale":"2022-09-17T10:27:46.877241+0000","last_undegraded":"2022-09-17T10:27:46.877241+0000","last_fullsized":"2022-09-17T10:27:46.877241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823138+0000","last_change":"2022-09-17T10:27:42.422220+0000","last_active":"2022-09-17T10:27:46.823138+0000","last_peered":"2022-09-17T10:27:46.823138+0000","last_clean":"2022-09-17T10:27:46.823138+0000","last_became_active":"2022-09-17T10:27:42.421941+0000","last_became_peered":"2022-09-17T10:27:42.421941+0000","last_unstale":"2022-09-17T10:27:46.823138+0000","last_undegraded":"2022-09-17T10:27:46.823138+0000","last_fullsized":"2022-09-17T10:27:46.823138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.827201+0000","last_change":"2022-09-17T10:27:37.394582+0000","last_active":"2022-09-17T10:27:46.827201+0000","last_peered":"2022-09-17T10:27:46.827201+0000","last_clean":"2022-09-17T10:27:46.827201+0000","last_became_active":"2022-09-17T10:27:37.394285+0000","last_became_peered":"2022-09-17T10:27:37.394285+0000","last_unstale":"2022-09-17T10:27:46.827201+0000","last_undegraded":"2022-09-17T10:27:46.827201+0000","last_fullsized":"2022-09-17T10:27:46.827201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.881600+0000","last_change":"2022-09-17T10:27:46.880385+0000","last_active":"2022-09-17T10:27:46.881600+0000","last_peered":"2022-09-17T10:27:46.881600+0000","last_clean":"2022-09-17T10:27:46.881600+0000","last_became_active":"2022-09-17T10:27:46.878700+0000","last_became_peered":"2022-09-17T10:27:46.878700+0000","last_unstale":"2022-09-17T10:27:46.881600+0000","last_undegraded":"2022-09-17T10:27:46.881600+0000","last_fullsized":"2022-09-17T10:27:46.881600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832695+0000","last_change":"2022-09-17T10:27:42.817890+0000","last_active":"2022-09-17T10:27:46.832695+0000","last_peered":"2022-09-17T10:27:46.832695+0000","last_clean":"2022-09-17T10:27:46.832695+0000","last_became_active":"2022-09-17T10:27:42.817601+0000","last_became_peered":"2022-09-17T10:27:42.817601+0000","last_unstale":"2022-09-17T10:27:46.832695+0000","last_undegraded":"2022-09-17T10:27:46.832695+0000","last_fullsized":"2022-09-17T10:27:46.832695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823749+0000","last_change":"2022-09-17T10:27:42.423365+0000","last_active":"2022-09-17T10:27:46.823749+0000","last_peered":"2022-09-17T10:27:46.823749+0000","last_clean":"2022-09-17T10:27:46.823749+0000","last_became_active":"2022-09-17T10:27:42.423033+0000","last_became_peered":"2022-09-17T10:27:42.423033+0000","last_unstale":"2022-09-17T10:27:46.823749+0000","last_undegraded":"2022-09-17T10:27:46.823749+0000","last_fullsized":"2022-09-17T10:27:46.823749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823623+0000","last_change":"2022-09-17T10:27:37.525398+0000","last_active":"2022-09-17T10:27:46.823623+0000","last_peered":"2022-09-17T10:27:46.823623+0000","last_clean":"2022-09-17T10:27:46.823623+0000","last_became_active":"2022-09-17T10:27:37.525103+0000","last_became_peered":"2022-09-17T10:27:37.525103+0000","last_unstale":"2022-09-17T10:27:46.823623+0000","last_undegraded":"2022-09-17T10:27:46.823623+0000","last_fullsized":"2022-09-17T10:27:46.823623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:36.372592+0000","last_clean_scrub_stamp":"2022-09-17T10:27:36.372592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879752+0000","last_change":"2022-09-17T10:27:46.877751+0000","last_active":"2022-09-17T10:27:46.879752+0000","last_peered":"2022-09-17T10:27:46.879752+0000","last_clean":"2022-09-17T10:27:46.879752+0000","last_became_active":"2022-09-17T10:27:46.877299+0000","last_became_peered":"2022-09-17T10:27:46.877299+0000","last_unstale":"2022-09-17T10:27:46.879752+0000","last_undegraded":"2022-09-17T10:27:46.879752+0000","last_fullsized":"2022-09-17T10:27:46.879752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823812+0000","last_change":"2022-09-17T10:27:42.420366+0000","last_active":"2022-09-17T10:27:46.823812+0000","last_peered":"2022-09-17T10:27:46.823812+0000","last_clean":"2022-09-17T10:27:46.823812+0000","last_became_active":"2022-09-17T10:27:42.420013+0000","last_became_peered":"2022-09-17T10:27:42.420013+0000","last_unstale":"2022-09-17T10:27:46.823812+0000","last_undegraded":"2022-09-17T10:27:46.823812+0000","last_fullsized":"2022-09-17T10:27:46.823812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824918+0000","last_change":"2022-09-17T10:27:42.806721+0000","last_active":"2022-09-17T10:27:46.824918+0000","last_peered":"2022-09-17T10:27:46.824918+0000","last_clean":"2022-09-17T10:27:46.824918+0000","last_became_active":"2022-09-17T10:27:42.806357+0000","last_became_peered":"2022-09-17T10:27:42.806357+0000","last_unstale":"2022-09-17T10:27:46.824918+0000","last_undegraded":"2022-09-17T10:27:46.824918+0000","last_fullsized":"2022-09-17T10:27:46.824918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.882851+0000","last_change":"2022-09-17T10:27:46.882310+0000","last_active":"2022-09-17T10:27:46.882851+0000","last_peered":"2022-09-17T10:27:46.882851+0000","last_clean":"2022-09-17T10:27:46.882851+0000","last_became_active":"2022-09-17T10:27:46.881958+0000","last_became_peered":"2022-09-17T10:27:46.881958+0000","last_unstale":"2022-09-17T10:27:46.882851+0000","last_undegraded":"2022-09-17T10:27:46.882851+0000","last_fullsized":"2022-09-17T10:27:46.882851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832635+0000","last_change":"2022-09-17T10:27:42.420727+0000","last_active":"2022-09-17T10:27:46.832635+0000","last_peered":"2022-09-17T10:27:46.832635+0000","last_clean":"2022-09-17T10:27:46.832635+0000","last_became_active":"2022-09-17T10:27:42.420318+0000","last_became_peered":"2022-09-17T10:27:42.420318+0000","last_unstale":"2022-09-17T10:27:46.832635+0000","last_undegraded":"2022-09-17T10:27:46.832635+0000","last_fullsized":"2022-09-17T10:27:46.832635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821086+0000","last_change":"2022-09-17T10:27:42.816236+0000","last_active":"2022-09-17T10:27:46.821086+0000","last_peered":"2022-09-17T10:27:46.821086+0000","last_clean":"2022-09-17T10:27:46.821086+0000","last_became_active":"2022-09-17T10:27:42.815964+0000","last_became_peered":"2022-09-17T10:27:42.815964+0000","last_unstale":"2022-09-17T10:27:46.821086+0000","last_undegraded":"2022-09-17T10:27:46.821086+0000","last_fullsized":"2022-09-17T10:27:46.821086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838996+0000","last_change":"2022-09-17T10:27:46.833473+0000","last_active":"2022-09-17T10:27:46.838996+0000","last_peered":"2022-09-17T10:27:46.838996+0000","last_clean":"2022-09-17T10:27:46.838996+0000","last_became_active":"2022-09-17T10:27:46.832774+0000","last_became_peered":"2022-09-17T10:27:46.832774+0000","last_unstale":"2022-09-17T10:27:46.838996+0000","last_undegraded":"2022-09-17T10:27:46.838996+0000","last_fullsized":"2022-09-17T10:27:46.838996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826647+0000","last_change":"2022-09-17T10:27:42.417006+0000","last_active":"2022-09-17T10:27:46.826647+0000","last_peered":"2022-09-17T10:27:46.826647+0000","last_clean":"2022-09-17T10:27:46.826647+0000","last_became_active":"2022-09-17T10:27:42.416679+0000","last_became_peered":"2022-09-17T10:27:42.416679+0000","last_unstale":"2022-09-17T10:27:46.826647+0000","last_undegraded":"2022-09-17T10:27:46.826647+0000","last_fullsized":"2022-09-17T10:27:46.826647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821361+0000","last_change":"2022-09-17T10:27:42.814951+0000","last_active":"2022-09-17T10:27:46.821361+0000","last_peered":"2022-09-17T10:27:46.821361+0000","last_clean":"2022-09-17T10:27:46.821361+0000","last_became_active":"2022-09-17T10:27:42.814659+0000","last_became_peered":"2022-09-17T10:27:42.814659+0000","last_unstale":"2022-09-17T10:27:46.821361+0000","last_undegraded":"2022-09-17T10:27:46.821361+0000","last_fullsized":"2022-09-17T10:27:46.821361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.836181+0000","last_change":"2022-09-17T10:27:46.835414+0000","last_active":"2022-09-17T10:27:46.836181+0000","last_peered":"2022-09-17T10:27:46.836181+0000","last_clean":"2022-09-17T10:27:46.836181+0000","last_became_active":"2022-09-17T10:27:46.834968+0000","last_became_peered":"2022-09-17T10:27:46.834968+0000","last_unstale":"2022-09-17T10:27:46.836181+0000","last_undegraded":"2022-09-17T10:27:46.836181+0000","last_fullsized":"2022-09-17T10:27:46.836181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.902523+0000","last_change":"2022-09-17T10:27:42.422793+0000","last_active":"2022-09-17T10:27:47.902523+0000","last_peered":"2022-09-17T10:27:47.902523+0000","last_clean":"2022-09-17T10:27:47.902523+0000","last_became_active":"2022-09-17T10:27:42.422337+0000","last_became_peered":"2022-09-17T10:27:42.422337+0000","last_unstale":"2022-09-17T10:27:47.902523+0000","last_undegraded":"2022-09-17T10:27:47.902523+0000","last_fullsized":"2022-09-17T10:27:47.902523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822194+0000","last_change":"2022-09-17T10:27:42.811550+0000","last_active":"2022-09-17T10:27:46.822194+0000","last_peered":"2022-09-17T10:27:46.822194+0000","last_clean":"2022-09-17T10:27:46.822194+0000","last_became_active":"2022-09-17T10:27:42.811253+0000","last_became_peered":"2022-09-17T10:27:42.811253+0000","last_unstale":"2022-09-17T10:27:46.822194+0000","last_undegraded":"2022-09-17T10:27:46.822194+0000","last_fullsized":"2022-09-17T10:27:46.822194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838391+0000","last_change":"2022-09-17T10:27:46.835511+0000","last_active":"2022-09-17T10:27:46.838391+0000","last_peered":"2022-09-17T10:27:46.838391+0000","last_clean":"2022-09-17T10:27:46.838391+0000","last_became_active":"2022-09-17T10:27:46.835134+0000","last_became_peered":"2022-09-17T10:27:46.835134+0000","last_unstale":"2022-09-17T10:27:46.838391+0000","last_undegraded":"2022-09-17T10:27:46.838391+0000","last_fullsized":"2022-09-17T10:27:46.838391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826910+0000","last_change":"2022-09-17T10:27:42.422231+0000","last_active":"2022-09-17T10:27:46.826910+0000","last_peered":"2022-09-17T10:27:46.826910+0000","last_clean":"2022-09-17T10:27:46.826910+0000","last_became_active":"2022-09-17T10:27:42.421108+0000","last_became_peered":"2022-09-17T10:27:42.421108+0000","last_unstale":"2022-09-17T10:27:46.826910+0000","last_undegraded":"2022-09-17T10:27:46.826910+0000","last_fullsized":"2022-09-17T10:27:46.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824550+0000","last_change":"2022-09-17T10:27:42.806733+0000","last_active":"2022-09-17T10:27:46.824550+0000","last_peered":"2022-09-17T10:27:46.824550+0000","last_clean":"2022-09-17T10:27:46.824550+0000","last_became_active":"2022-09-17T10:27:42.806446+0000","last_became_peered":"2022-09-17T10:27:42.806446+0000","last_unstale":"2022-09-17T10:27:46.824550+0000","last_undegraded":"2022-09-17T10:27:46.824550+0000","last_fullsized":"2022-09-17T10:27:46.824550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839217+0000","last_change":"2022-09-17T10:27:46.836402+0000","last_active":"2022-09-17T10:27:46.839217+0000","last_peered":"2022-09-17T10:27:46.839217+0000","last_clean":"2022-09-17T10:27:46.839217+0000","last_became_active":"2022-09-17T10:27:46.836002+0000","last_became_peered":"2022-09-17T10:27:46.836002+0000","last_unstale":"2022-09-17T10:27:46.839217+0000","last_undegraded":"2022-09-17T10:27:46.839217+0000","last_fullsized":"2022-09-17T10:27:46.839217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828495+0000","last_change":"2022-09-17T10:27:42.421493+0000","last_active":"2022-09-17T10:27:46.828495+0000","last_peered":"2022-09-17T10:27:46.828495+0000","last_clean":"2022-09-17T10:27:46.828495+0000","last_became_active":"2022-09-17T10:27:42.421137+0000","last_became_peered":"2022-09-17T10:27:42.421137+0000","last_unstale":"2022-09-17T10:27:46.828495+0000","last_undegraded":"2022-09-17T10:27:46.828495+0000","last_fullsized":"2022-09-17T10:27:46.828495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.828502+0000","last_change":"2022-09-17T10:27:42.812206+0000","last_active":"2022-09-17T10:27:46.828502+0000","last_peered":"2022-09-17T10:27:46.828502+0000","last_clean":"2022-09-17T10:27:46.828502+0000","last_became_active":"2022-09-17T10:27:42.811911+0000","last_became_peered":"2022-09-17T10:27:42.811911+0000","last_unstale":"2022-09-17T10:27:46.828502+0000","last_undegraded":"2022-09-17T10:27:46.828502+0000","last_fullsized":"2022-09-17T10:27:46.828502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.837793+0000","last_change":"2022-09-17T10:27:46.836695+0000","last_active":"2022-09-17T10:27:46.837793+0000","last_peered":"2022-09-17T10:27:46.837793+0000","last_clean":"2022-09-17T10:27:46.837793+0000","last_became_active":"2022-09-17T10:27:46.836236+0000","last_became_peered":"2022-09-17T10:27:46.836236+0000","last_unstale":"2022-09-17T10:27:46.837793+0000","last_undegraded":"2022-09-17T10:27:46.837793+0000","last_fullsized":"2022-09-17T10:27:46.837793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822969+0000","last_change":"2022-09-17T10:27:42.418839+0000","last_active":"2022-09-17T10:27:46.822969+0000","last_peered":"2022-09-17T10:27:46.822969+0000","last_clean":"2022-09-17T10:27:46.822969+0000","last_became_active":"2022-09-17T10:27:42.418555+0000","last_became_peered":"2022-09-17T10:27:42.418555+0000","last_unstale":"2022-09-17T10:27:46.822969+0000","last_undegraded":"2022-09-17T10:27:46.822969+0000","last_fullsized":"2022-09-17T10:27:46.822969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825849+0000","last_change":"2022-09-17T10:27:42.820270+0000","last_active":"2022-09-17T10:27:46.825849+0000","last_peered":"2022-09-17T10:27:46.825849+0000","last_clean":"2022-09-17T10:27:46.825849+0000","last_became_active":"2022-09-17T10:27:42.820082+0000","last_became_peered":"2022-09-17T10:27:42.820082+0000","last_unstale":"2022-09-17T10:27:46.825849+0000","last_undegraded":"2022-09-17T10:27:46.825849+0000","last_fullsized":"2022-09-17T10:27:46.825849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832187+0000","last_change":"2022-09-17T10:27:46.830924+0000","last_active":"2022-09-17T10:27:46.832187+0000","last_peered":"2022-09-17T10:27:46.832187+0000","last_clean":"2022-09-17T10:27:46.832187+0000","last_became_active":"2022-09-17T10:27:46.830492+0000","last_became_peered":"2022-09-17T10:27:46.830492+0000","last_unstale":"2022-09-17T10:27:46.832187+0000","last_undegraded":"2022-09-17T10:27:46.832187+0000","last_fullsized":"2022-09-17T10:27:46.832187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.902985+0000","last_change":"2022-09-17T10:27:42.419790+0000","last_active":"2022-09-17T10:27:47.902985+0000","last_peered":"2022-09-17T10:27:47.902985+0000","last_clean":"2022-09-17T10:27:47.902985+0000","last_became_active":"2022-09-17T10:27:42.419230+0000","last_became_peered":"2022-09-17T10:27:42.419230+0000","last_unstale":"2022-09-17T10:27:47.902985+0000","last_undegraded":"2022-09-17T10:27:47.902985+0000","last_fullsized":"2022-09-17T10:27:47.902985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825970+0000","last_change":"2022-09-17T10:27:42.818878+0000","last_active":"2022-09-17T10:27:46.825970+0000","last_peered":"2022-09-17T10:27:46.825970+0000","last_clean":"2022-09-17T10:27:46.825970+0000","last_became_active":"2022-09-17T10:27:42.818634+0000","last_became_peered":"2022-09-17T10:27:42.818634+0000","last_unstale":"2022-09-17T10:27:46.825970+0000","last_undegraded":"2022-09-17T10:27:46.825970+0000","last_fullsized":"2022-09-17T10:27:46.825970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839835+0000","last_change":"2022-09-17T10:27:46.832459+0000","last_active":"2022-09-17T10:27:46.839835+0000","last_peered":"2022-09-17T10:27:46.839835+0000","last_clean":"2022-09-17T10:27:46.839835+0000","last_became_active":"2022-09-17T10:27:46.831882+0000","last_became_peered":"2022-09-17T10:27:46.831882+0000","last_unstale":"2022-09-17T10:27:46.839835+0000","last_undegraded":"2022-09-17T10:27:46.839835+0000","last_fullsized":"2022-09-17T10:27:46.839835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"26'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826302+0000","last_change":"2022-09-17T10:27:42.418968+0000","last_active":"2022-09-17T10:27:46.826302+0000","last_peered":"2022-09-17T10:27:46.826302+0000","last_clean":"2022-09-17T10:27:46.826302+0000","last_became_active":"2022-09-17T10:27:42.418688+0000","last_became_peered":"2022-09-17T10:27:42.418688+0000","last_unstale":"2022-09-17T10:27:46.826302+0000","last_undegraded":"2022-09-17T10:27:46.826302+0000","last_fullsized":"2022-09-17T10:27:46.826302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824990+0000","last_change":"2022-09-17T10:27:42.811058+0000","last_active":"2022-09-17T10:27:46.824990+0000","last_peered":"2022-09-17T10:27:46.824990+0000","last_clean":"2022-09-17T10:27:46.824990+0000","last_became_active":"2022-09-17T10:27:42.810786+0000","last_became_peered":"2022-09-17T10:27:42.810786+0000","last_unstale":"2022-09-17T10:27:46.824990+0000","last_undegraded":"2022-09-17T10:27:46.824990+0000","last_fullsized":"2022-09-17T10:27:46.824990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879743+0000","last_change":"2022-09-17T10:27:46.878357+0000","last_active":"2022-09-17T10:27:46.879743+0000","last_peered":"2022-09-17T10:27:46.879743+0000","last_clean":"2022-09-17T10:27:46.879743+0000","last_became_active":"2022-09-17T10:27:46.877905+0000","last_became_peered":"2022-09-17T10:27:46.877905+0000","last_unstale":"2022-09-17T10:27:46.879743+0000","last_undegraded":"2022-09-17T10:27:46.879743+0000","last_fullsized":"2022-09-17T10:27:46.879743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.825843+0000","last_change":"2022-09-17T10:27:42.423000+0000","last_active":"2022-09-17T10:27:46.825843+0000","last_peered":"2022-09-17T10:27:46.825843+0000","last_clean":"2022-09-17T10:27:46.825843+0000","last_became_active":"2022-09-17T10:27:42.422682+0000","last_became_peered":"2022-09-17T10:27:42.422682+0000","last_unstale":"2022-09-17T10:27:46.825843+0000","last_undegraded":"2022-09-17T10:27:46.825843+0000","last_fullsized":"2022-09-17T10:27:46.825843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879543+0000","last_change":"2022-09-17T10:27:42.811159+0000","last_active":"2022-09-17T10:27:46.879543+0000","last_peered":"2022-09-17T10:27:46.879543+0000","last_clean":"2022-09-17T10:27:46.879543+0000","last_became_active":"2022-09-17T10:27:42.810820+0000","last_became_peered":"2022-09-17T10:27:42.810820+0000","last_unstale":"2022-09-17T10:27:46.879543+0000","last_undegraded":"2022-09-17T10:27:46.879543+0000","last_fullsized":"2022-09-17T10:27:46.879543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.839921+0000","last_change":"2022-09-17T10:27:46.838653+0000","last_active":"2022-09-17T10:27:46.839921+0000","last_peered":"2022-09-17T10:27:46.839921+0000","last_clean":"2022-09-17T10:27:46.839921+0000","last_became_active":"2022-09-17T10:27:46.838287+0000","last_became_peered":"2022-09-17T10:27:46.838287+0000","last_unstale":"2022-09-17T10:27:46.839921+0000","last_undegraded":"2022-09-17T10:27:46.839921+0000","last_fullsized":"2022-09-17T10:27:46.839921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.877630+0000","last_change":"2022-09-17T10:27:42.419648+0000","last_active":"2022-09-17T10:27:46.877630+0000","last_peered":"2022-09-17T10:27:46.877630+0000","last_clean":"2022-09-17T10:27:46.877630+0000","last_became_active":"2022-09-17T10:27:42.419364+0000","last_became_peered":"2022-09-17T10:27:42.419364+0000","last_unstale":"2022-09-17T10:27:46.877630+0000","last_undegraded":"2022-09-17T10:27:46.877630+0000","last_fullsized":"2022-09-17T10:27:46.877630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.826647+0000","last_change":"2022-09-17T10:27:42.816825+0000","last_active":"2022-09-17T10:27:46.826647+0000","last_peered":"2022-09-17T10:27:46.826647+0000","last_clean":"2022-09-17T10:27:46.826647+0000","last_became_active":"2022-09-17T10:27:42.816570+0000","last_became_peered":"2022-09-17T10:27:42.816570+0000","last_unstale":"2022-09-17T10:27:46.826647+0000","last_undegraded":"2022-09-17T10:27:46.826647+0000","last_fullsized":"2022-09-17T10:27:46.826647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841041+0000","last_change":"2022-09-17T10:27:46.840020+0000","last_active":"2022-09-17T10:27:46.841041+0000","last_peered":"2022-09-17T10:27:46.841041+0000","last_clean":"2022-09-17T10:27:46.841041+0000","last_became_active":"2022-09-17T10:27:46.839506+0000","last_became_peered":"2022-09-17T10:27:46.839506+0000","last_unstale":"2022-09-17T10:27:46.841041+0000","last_undegraded":"2022-09-17T10:27:46.841041+0000","last_fullsized":"2022-09-17T10:27:46.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:27:47.903171+0000","last_change":"2022-09-17T10:27:42.422080+0000","last_active":"2022-09-17T10:27:47.903171+0000","last_peered":"2022-09-17T10:27:47.903171+0000","last_clean":"2022-09-17T10:27:47.903171+0000","last_became_active":"2022-09-17T10:27:42.421800+0000","last_became_peered":"2022-09-17T10:27:42.421800+0000","last_unstale":"2022-09-17T10:27:47.903171+0000","last_undegraded":"2022-09-17T10:27:47.903171+0000","last_fullsized":"2022-09-17T10:27:47.903171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822002+0000","last_change":"2022-09-17T10:27:42.813833+0000","last_active":"2022-09-17T10:27:46.822002+0000","last_peered":"2022-09-17T10:27:46.822002+0000","last_clean":"2022-09-17T10:27:46.822002+0000","last_became_active":"2022-09-17T10:27:42.813026+0000","last_became_peered":"2022-09-17T10:27:42.813026+0000","last_unstale":"2022-09-17T10:27:46.822002+0000","last_undegraded":"2022-09-17T10:27:46.822002+0000","last_fullsized":"2022-09-17T10:27:46.822002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838329+0000","last_change":"2022-09-17T10:27:46.836347+0000","last_active":"2022-09-17T10:27:46.838329+0000","last_peered":"2022-09-17T10:27:46.838329+0000","last_clean":"2022-09-17T10:27:46.838329+0000","last_became_active":"2022-09-17T10:27:46.835868+0000","last_became_peered":"2022-09-17T10:27:46.835868+0000","last_unstale":"2022-09-17T10:27:46.838329+0000","last_undegraded":"2022-09-17T10:27:46.838329+0000","last_fullsized":"2022-09-17T10:27:46.838329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"26'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2022-09-17T10:28:01.974641+0000","last_change":"2022-09-17T10:27:42.418108+0000","last_active":"2022-09-17T10:28:01.974641+0000","last_peered":"2022-09-17T10:28:01.974641+0000","last_clean":"2022-09-17T10:28:01.974641+0000","last_became_active":"2022-09-17T10:27:42.417757+0000","last_became_peered":"2022-09-17T10:27:42.417757+0000","last_unstale":"2022-09-17T10:28:01.974641+0000","last_undegraded":"2022-09-17T10:28:01.974641+0000","last_fullsized":"2022-09-17T10:28:01.974641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.821123+0000","last_change":"2022-09-17T10:27:42.817463+0000","last_active":"2022-09-17T10:27:46.821123+0000","last_peered":"2022-09-17T10:27:46.821123+0000","last_clean":"2022-09-17T10:27:46.821123+0000","last_became_active":"2022-09-17T10:27:42.816834+0000","last_became_peered":"2022-09-17T10:27:42.816834+0000","last_unstale":"2022-09-17T10:27:46.821123+0000","last_undegraded":"2022-09-17T10:27:46.821123+0000","last_fullsized":"2022-09-17T10:27:46.821123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841734+0000","last_change":"2022-09-17T10:27:46.841024+0000","last_active":"2022-09-17T10:27:46.841734+0000","last_peered":"2022-09-17T10:27:46.841734+0000","last_clean":"2022-09-17T10:27:46.841734+0000","last_became_active":"2022-09-17T10:27:46.840603+0000","last_became_peered":"2022-09-17T10:27:46.840603+0000","last_unstale":"2022-09-17T10:27:46.841734+0000","last_undegraded":"2022-09-17T10:27:46.841734+0000","last_fullsized":"2022-09-17T10:27:46.841734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"26'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832780+0000","last_change":"2022-09-17T10:27:42.420701+0000","last_active":"2022-09-17T10:27:46.832780+0000","last_peered":"2022-09-17T10:27:46.832780+0000","last_clean":"2022-09-17T10:27:46.832780+0000","last_became_active":"2022-09-17T10:27:42.420411+0000","last_became_peered":"2022-09-17T10:27:42.420411+0000","last_unstale":"2022-09-17T10:27:46.832780+0000","last_undegraded":"2022-09-17T10:27:46.832780+0000","last_fullsized":"2022-09-17T10:27:46.832780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824113+0000","last_change":"2022-09-17T10:27:42.815787+0000","last_active":"2022-09-17T10:27:46.824113+0000","last_peered":"2022-09-17T10:27:46.824113+0000","last_clean":"2022-09-17T10:27:46.824113+0000","last_became_active":"2022-09-17T10:27:42.815574+0000","last_became_peered":"2022-09-17T10:27:42.815574+0000","last_unstale":"2022-09-17T10:27:46.824113+0000","last_undegraded":"2022-09-17T10:27:46.824113+0000","last_fullsized":"2022-09-17T10:27:46.824113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.841390+0000","last_change":"2022-09-17T10:27:46.840878+0000","last_active":"2022-09-17T10:27:46.841390+0000","last_peered":"2022-09-17T10:27:46.841390+0000","last_clean":"2022-09-17T10:27:46.841390+0000","last_became_active":"2022-09-17T10:27:46.840406+0000","last_became_peered":"2022-09-17T10:27:46.840406+0000","last_unstale":"2022-09-17T10:27:46.841390+0000","last_undegraded":"2022-09-17T10:27:46.841390+0000","last_fullsized":"2022-09-17T10:27:46.841390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.829101+0000","last_change":"2022-09-17T10:27:42.416329+0000","last_active":"2022-09-17T10:27:46.829101+0000","last_peered":"2022-09-17T10:27:46.829101+0000","last_clean":"2022-09-17T10:27:46.829101+0000","last_became_active":"2022-09-17T10:27:42.415993+0000","last_became_peered":"2022-09-17T10:27:42.415993+0000","last_unstale":"2022-09-17T10:27:46.829101+0000","last_undegraded":"2022-09-17T10:27:46.829101+0000","last_fullsized":"2022-09-17T10:27:46.829101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.831132+0000","last_change":"2022-09-17T10:27:42.816319+0000","last_active":"2022-09-17T10:27:46.831132+0000","last_peered":"2022-09-17T10:27:46.831132+0000","last_clean":"2022-09-17T10:27:46.831132+0000","last_became_active":"2022-09-17T10:27:42.815852+0000","last_became_peered":"2022-09-17T10:27:42.815852+0000","last_unstale":"2022-09-17T10:27:46.831132+0000","last_undegraded":"2022-09-17T10:27:46.831132+0000","last_fullsized":"2022-09-17T10:27:46.831132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838936+0000","last_change":"2022-09-17T10:27:46.834933+0000","last_active":"2022-09-17T10:27:46.838936+0000","last_peered":"2022-09-17T10:27:46.838936+0000","last_clean":"2022-09-17T10:27:46.838936+0000","last_became_active":"2022-09-17T10:27:46.834522+0000","last_became_peered":"2022-09-17T10:27:46.834522+0000","last_unstale":"2022-09-17T10:27:46.838936+0000","last_undegraded":"2022-09-17T10:27:46.838936+0000","last_fullsized":"2022-09-17T10:27:46.838936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823794+0000","last_change":"2022-09-17T10:27:42.421873+0000","last_active":"2022-09-17T10:27:46.823794+0000","last_peered":"2022-09-17T10:27:46.823794+0000","last_clean":"2022-09-17T10:27:46.823794+0000","last_became_active":"2022-09-17T10:27:42.421587+0000","last_became_peered":"2022-09-17T10:27:42.421587+0000","last_unstale":"2022-09-17T10:27:46.823794+0000","last_undegraded":"2022-09-17T10:27:46.823794+0000","last_fullsized":"2022-09-17T10:27:46.823794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823867+0000","last_change":"2022-09-17T10:27:42.805008+0000","last_active":"2022-09-17T10:27:46.823867+0000","last_peered":"2022-09-17T10:27:46.823867+0000","last_clean":"2022-09-17T10:27:46.823867+0000","last_became_active":"2022-09-17T10:27:42.804736+0000","last_became_peered":"2022-09-17T10:27:42.804736+0000","last_unstale":"2022-09-17T10:27:46.823867+0000","last_undegraded":"2022-09-17T10:27:46.823867+0000","last_fullsized":"2022-09-17T10:27:46.823867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.840417+0000","last_change":"2022-09-17T10:27:46.839700+0000","last_active":"2022-09-17T10:27:46.840417+0000","last_peered":"2022-09-17T10:27:46.840417+0000","last_clean":"2022-09-17T10:27:46.840417+0000","last_became_active":"2022-09-17T10:27:46.839222+0000","last_became_peered":"2022-09-17T10:27:46.839222+0000","last_unstale":"2022-09-17T10:27:46.840417+0000","last_undegraded":"2022-09-17T10:27:46.840417+0000","last_fullsized":"2022-09-17T10:27:46.840417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.837453+0000","last_change":"2022-09-17T10:27:46.835973+0000","last_active":"2022-09-17T10:27:46.837453+0000","last_peered":"2022-09-17T10:27:46.837453+0000","last_clean":"2022-09-17T10:27:46.837453+0000","last_became_active":"2022-09-17T10:27:46.835370+0000","last_became_peered":"2022-09-17T10:27:46.835370+0000","last_unstale":"2022-09-17T10:27:46.837453+0000","last_undegraded":"2022-09-17T10:27:46.837453+0000","last_fullsized":"2022-09-17T10:27:46.837453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.830729+0000","last_change":"2022-09-17T10:27:42.424396+0000","last_active":"2022-09-17T10:27:46.830729+0000","last_peered":"2022-09-17T10:27:46.830729+0000","last_clean":"2022-09-17T10:27:46.830729+0000","last_became_active":"2022-09-17T10:27:42.424106+0000","last_became_peered":"2022-09-17T10:27:42.424106+0000","last_unstale":"2022-09-17T10:27:46.830729+0000","last_undegraded":"2022-09-17T10:27:46.830729+0000","last_fullsized":"2022-09-17T10:27:46.830729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.822522+0000","last_change":"2022-09-17T10:27:42.813371+0000","last_active":"2022-09-17T10:27:46.822522+0000","last_peered":"2022-09-17T10:27:46.822522+0000","last_clean":"2022-09-17T10:27:46.822522+0000","last_became_active":"2022-09-17T10:27:42.813093+0000","last_became_peered":"2022-09-17T10:27:42.813093+0000","last_unstale":"2022-09-17T10:27:46.822522+0000","last_undegraded":"2022-09-17T10:27:46.822522+0000","last_fullsized":"2022-09-17T10:27:46.822522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.838300+0000","last_change":"2022-09-17T10:27:46.836367+0000","last_active":"2022-09-17T10:27:46.838300+0000","last_peered":"2022-09-17T10:27:46.838300+0000","last_clean":"2022-09-17T10:27:46.838300+0000","last_became_active":"2022-09-17T10:27:46.835670+0000","last_became_peered":"2022-09-17T10:27:46.835670+0000","last_unstale":"2022-09-17T10:27:46.838300+0000","last_undegraded":"2022-09-17T10:27:46.838300+0000","last_fullsized":"2022-09-17T10:27:46.838300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823937+0000","last_change":"2022-09-17T10:27:42.425999+0000","last_active":"2022-09-17T10:27:46.823937+0000","last_peered":"2022-09-17T10:27:46.823937+0000","last_clean":"2022-09-17T10:27:46.823937+0000","last_became_active":"2022-09-17T10:27:42.425650+0000","last_became_peered":"2022-09-17T10:27:42.425650+0000","last_unstale":"2022-09-17T10:27:46.823937+0000","last_undegraded":"2022-09-17T10:27:46.823937+0000","last_fullsized":"2022-09-17T10:27:46.823937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.823053+0000","last_change":"2022-09-17T10:27:42.807915+0000","last_active":"2022-09-17T10:27:46.823053+0000","last_peered":"2022-09-17T10:27:46.823053+0000","last_clean":"2022-09-17T10:27:46.823053+0000","last_became_active":"2022-09-17T10:27:42.807621+0000","last_became_peered":"2022-09-17T10:27:42.807621+0000","last_unstale":"2022-09-17T10:27:46.823053+0000","last_undegraded":"2022-09-17T10:27:46.823053+0000","last_fullsized":"2022-09-17T10:27:46.823053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.832588+0000","last_change":"2022-09-17T10:27:42.418946+0000","last_active":"2022-09-17T10:27:46.832588+0000","last_peered":"2022-09-17T10:27:46.832588+0000","last_clean":"2022-09-17T10:27:46.832588+0000","last_became_active":"2022-09-17T10:27:42.418576+0000","last_became_peered":"2022-09-17T10:27:42.418576+0000","last_unstale":"2022-09-17T10:27:46.832588+0000","last_undegraded":"2022-09-17T10:27:46.832588+0000","last_fullsized":"2022-09-17T10:27:46.832588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:41.392961+0000","last_clean_scrub_stamp":"2022-09-17T10:27:41.392961+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.824054+0000","last_change":"2022-09-17T10:27:42.817091+0000","last_active":"2022-09-17T10:27:46.824054+0000","last_peered":"2022-09-17T10:27:46.824054+0000","last_clean":"2022-09-17T10:27:46.824054+0000","last_became_active":"2022-09-17T10:27:42.816783+0000","last_became_peered":"2022-09-17T10:27:42.816783+0000","last_unstale":"2022-09-17T10:27:46.824054+0000","last_undegraded":"2022-09-17T10:27:46.824054+0000","last_fullsized":"2022-09-17T10:27:46.824054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:42.397714+0000","last_clean_scrub_stamp":"2022-09-17T10:27:42.397714+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2022-09-17T10:27:46.879369+0000","last_change":"2022-09-17T10:27:46.878071+0000","last_active":"2022-09-17T10:27:46.879369+0000","last_peered":"2022-09-17T10:27:46.879369+0000","last_clean":"2022-09-17T10:27:46.879369+0000","last_became_active":"2022-09-17T10:27:46.877621+0000","last_became_peered":"2022-09-17T10:27:46.877621+0000","last_unstale":"2022-09-17T10:27:46.879369+0000","last_undegraded":"2022-09-17T10:27:46.879369+0000","last_fullsized":"2022-09-17T10:27:46.879369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-09-17T10:27:45.812434+0000","last_clean_scrub_stamp":"2022-09-17T10:27:45.812434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444042,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":161829,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":10,"up_from":17,"seq":73014444041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":164234,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":9,"up_from":17,"seq":73014444042,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":8,"up_from":17,"seq":73014444041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":161897,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5328,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366512,"statfs":{"total":96636764160,"available":96631308288,"internally_reserved":0,"allocated":335872,"data_stored":161219,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":6,"up_from":17,"seq":73014444040,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":17,"seq":73014444042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5332,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366508,"statfs":{"total":96636764160,"available":96631304192,"internally_reserved":0,"allocated":339968,"data_stored":162361,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":0,"up_from":17,"seq":73014444041,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":161233,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":3,"up_from":17,"seq":73014444041,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366516,"statfs":{"total":96636764160,"available":96631312384,"internally_reserved":0,"allocated":331776,"data_stored":161233,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":4,"up_from":17,"seq":73014444042,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5392,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366448,"statfs":{"total":96636764160,"available":96631242752,"internally_reserved":0,"allocated":335872,"data_stored":164268,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":161163,"data_compressed":11109,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-09-17T10:28:08.924 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-09-17T10:28:08.925 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-09-17T10:28:08.925 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-09-17T10:28:08.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-09-17T10:28:09.069 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.067+0000 7f59cd890700 1 Processor -- start 2022-09-17T10:28:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.067+0000 7f59cd890700 1 -- start start 2022-09-17T10:28:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.068+0000 7f59cd890700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f59c80bc430 0x7f59c817e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.068+0000 7f59cd890700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c80e53f0 con 0x7f59c817dcf0 2022-09-17T10:28:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.068+0000 7f59cd890700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c80ed4b0 con 0x7f59c80e5880 2022-09-17T10:28:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.068+0000 7f59cd890700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c80bc880 con 0x7f59c80bc430 2022-09-17T10:28:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.068+0000 7f59cc88e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f59c817dcf0 0x7f59c80ecda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57802/0 (socket says 172.21.15.62:57802) 2022-09-17T10:28:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59cc88e700 1 -- 172.21.15.62:0/123847627 learned_addr learned my addr 172.21.15.62:0/123847627 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59cd08f700 1 --2- 172.21.15.62:0/123847627 >> v2:172.21.15.159:3300/0 conn(0x7f59c80bc430 0x7f59c817e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106722820 0 0) 0x7f59c80e53f0 con 0x7f59c817dcf0 2022-09-17T10:28:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a80033f0 con 0x7f59c817dcf0 2022-09-17T10:28:09.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761396274 0 0) 0x7f59c80ed4b0 con 0x7f59c80e5880 2022-09-17T10:28:09.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c80e53f0 con 0x7f59c80e5880 2022-09-17T10:28:09.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3439310017 0 0) 0x7f59a80033f0 con 0x7f59c817dcf0 2022-09-17T10:28:09.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 >> v2:172.21.15.159:3300/0 conn(0x7f59c80bc430 msgr2=0x7f59c817e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 --2- 172.21.15.62:0/123847627 >> v2:172.21.15.159:3300/0 conn(0x7f59c80bc430 0x7f59c817e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 >> v1:172.21.15.93:6789/0 conn(0x7f59c80e5880 legacy=0x7f59c80bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80bca60 con 0x7f59c817dcf0 2022-09-17T10:28:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f59c0001470 con 0x7f59c817dcf0 2022-09-17T10:28:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 >> v1:172.21.15.62:6789/0 conn(0x7f59c817dcf0 legacy=0x7f59c80ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59a8003ac0 0x7f59a8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8004690 0x7f59a8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59a8005070 0x7f59a800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80bc880 con 0x7f59a8005070 2022-09-17T10:28:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a800c010 con 0x7f59a8004690 2022-09-17T10:28:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a800c1d0 con 0x7f59a8003ac0 2022-09-17T10:28:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59cd08f700 1 --2- 172.21.15.62:0/123847627 >> v2:172.21.15.159:3300/0 conn(0x7f59c80bc430 0x7f59c817e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:28:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59cd08f700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59a8005070 0x7f59a800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59cc88e700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59a8003ac0 0x7f59a8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.069+0000 7f59c7fff700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8004690 0x7f59a8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd08f700 1 -- 172.21.15.62:0/123847627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59a8003ac0 msgr2=0x7f59a8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:09.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd08f700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59a8003ac0 0x7f59a8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd08f700 1 -- 172.21.15.62:0/123847627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8004690 msgr2=0x7f59a8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:09.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd08f700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8004690 0x7f59a8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd08f700 1 -- 172.21.15.62:0/123847627 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80033f0 con 0x7f59a8005070 2022-09-17T10:28:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd08f700 1 -- 172.21.15.62:0/123847627 reap_dead start 2022-09-17T10:28:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd08f700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59a8005070 0x7f59a800b8e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f59b0009c30 tx=0x7f59b0009060).ready entity=mon.0 client_cookie=df41d629b9a2dba3 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00095c0 con 0x7f59a8005070 2022-09-17T10:28:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000e710 con 0x7f59a8005070 2022-09-17T10:28:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59c77fe700 1 -- 172.21.15.62:0/123847627 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000eab0 con 0x7f59a8005070 2022-09-17T10:28:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd890700 1 -- 172.21.15.62:0/123847627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59a8005070 msgr2=0x7f59a800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd890700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59a8005070 0x7f59a800b8e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f59b0009c30 tx=0x7f59b0009060).stop 2022-09-17T10:28:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd890700 1 -- 172.21.15.62:0/123847627 shutdown_connections 2022-09-17T10:28:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd890700 1 --2- 172.21.15.62:0/123847627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59a8005070 0x7f59a800b8e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd890700 1 -- 172.21.15.62:0/123847627 >> 172.21.15.62:0/123847627 conn(0x7f59c805e410 msgr2=0x7f59c80ea420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd890700 1 -- 172.21.15.62:0/123847627 shutdown_connections 2022-09-17T10:28:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.070+0000 7f59cd890700 1 -- 172.21.15.62:0/123847627 wait complete. 2022-09-17T10:28:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.072+0000 7f59cd890700 1 Processor -- start 2022-09-17T10:28:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.072+0000 7f59cd890700 1 -- start start 2022-09-17T10:28:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd890700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8005070 0x7f59c8157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd890700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8158410 0x7f59c817a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd890700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59c817aa30 0x7f59c817aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd890700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81811b0 con 0x7f59c817aa30 2022-09-17T10:28:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd890700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8181490 con 0x7f59a8005070 2022-09-17T10:28:09.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd890700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8179a60 con 0x7f59c8158410 2022-09-17T10:28:09.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd08f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59c817aa30 0x7f59c817aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd08f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59c817aa30 0x7f59c817aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50118/0 (socket says 172.21.15.62:50118) 2022-09-17T10:28:09.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd08f700 1 -- 172.21.15.62:0/3417107450 learned_addr learned my addr 172.21.15.62:0/3417107450 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59c7fff700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8158410 0x7f59c817a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cc88e700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8005070 0x7f59c8157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd08f700 1 -- 172.21.15.62:0/3417107450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8158410 msgr2=0x7f59c817a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd08f700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8158410 0x7f59c817a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd08f700 1 -- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8005070 msgr2=0x7f59c8157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd08f700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8005070 0x7f59c8157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.073+0000 7f59cd08f700 1 -- 172.21.15.62:0/3417107450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8179d40 con 0x7f59c817aa30 2022-09-17T10:28:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.074+0000 7f59cd08f700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59c817aa30 0x7f59c817aeb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f59b0000c00 tx=0x7f59b0019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.074+0000 7f59c4ff9700 1 -- 172.21.15.62:0/3417107450 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000eea0 con 0x7f59c817aa30 2022-09-17T10:28:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.074+0000 7f59c4ff9700 1 -- 172.21.15.62:0/3417107450 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b0009100 con 0x7f59c817aa30 2022-09-17T10:28:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.074+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c817a020 con 0x7f59c817aa30 2022-09-17T10:28:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.074+0000 7f59c4ff9700 1 -- 172.21.15.62:0/3417107450 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0025670 con 0x7f59c817aa30 2022-09-17T10:28:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.074+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c80e6220 con 0x7f59c817aa30 2022-09-17T10:28:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.075+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c817a390 con 0x7f59c817aa30 2022-09-17T10:28:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.076+0000 7f59c4ff9700 1 -- 172.21.15.62:0/3417107450 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f59b00259e0 con 0x7f59c817aa30 2022-09-17T10:28:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.076+0000 7f59c4ff9700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f59ac08ba40 0x7f59ac08df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.076+0000 7f59c4ff9700 1 -- 172.21.15.62:0/3417107450 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f59b00b2200 con 0x7f59c817aa30 2022-09-17T10:28:09.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.076+0000 7f59cc88e700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f59ac08ba40 0x7f59ac08df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.077+0000 7f59cc88e700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f59ac08ba40 0x7f59ac08df00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f59c0000e10 tx=0x7f59c0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.080+0000 7f59c4ff9700 1 -- 172.21.15.62:0/3417107450 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f59b0082f30 con 0x7f59c817aa30 2022-09-17T10:28:09.293 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.291+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f59c81798c0 con 0x7f59c817aa30 2022-09-17T10:28:09.294 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.291+0000 7f59c4ff9700 1 -- 172.21.15.62:0/3417107450 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f59c81798c0 con 0x7f59c817aa30 2022-09-17T10:28:09.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f59ac08ba40 msgr2=0x7f59ac08df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f59ac08ba40 0x7f59ac08df00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f59c0000e10 tx=0x7f59c0009040).stop 2022-09-17T10:28:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59c817aa30 msgr2=0x7f59c817aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59c817aa30 0x7f59c817aeb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f59b0000c00 tx=0x7f59b0019000).stop 2022-09-17T10:28:09.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 shutdown_connections 2022-09-17T10:28:09.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f59ac08ba40 0x7f59ac08df00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59a8005070 0x7f59c8157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.299 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59c817aa30 0x7f59c817aeb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 --2- 172.21.15.62:0/3417107450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59c8158410 0x7f59c817a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 >> 172.21.15.62:0/3417107450 conn(0x7f59c805e410 msgr2=0x7f59c806b320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:09.300 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 shutdown_connections 2022-09-17T10:28:09.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.293+0000 7f59cd890700 1 -- 172.21.15.62:0/3417107450 wait complete. 2022-09-17T10:28:09.307 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-09-17T10:28:09.308 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-09-17T10:28:09.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:28:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.424+0000 7f3c2ccb1700 1 Processor -- start 2022-09-17T10:28:09.427 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.424+0000 7f3c2ccb1700 1 -- start start 2022-09-17T10:28:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c2ccb1700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c2817dfe0 0x7f3c280683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c2ccb1700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3c2817e3c0 0x7f3c28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.431 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c2ccb1700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2806a2a0 con 0x7f3c2817f260 2022-09-17T10:28:09.431 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c2ccb1700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c28068a30 con 0x7f3c2817e3c0 2022-09-17T10:28:09.431 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c2ccb1700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c28068d10 con 0x7f3c2817dfe0 2022-09-17T10:28:09.431 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c25d9b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3c2817e3c0 0x7f3c28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.432 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c25d9b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3c2817e3c0 0x7f3c28069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.62:59786/0 (socket says 172.21.15.62:59786) 2022-09-17T10:28:09.432 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c25d9b700 1 -- 172.21.15.62:0/1475299937 learned_addr learned my addr 172.21.15.62:0/1475299937 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:09.432 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c26d9d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3c2817f260 0x7f3c28084010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.62:54638/0 (socket says 172.21.15.62:54638) 2022-09-17T10:28:09.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.425+0000 7f3c2659c700 1 --2- 172.21.15.62:0/1475299937 >> v2:172.21.15.159:3300/0 conn(0x7f3c2817dfe0 0x7f3c280683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c25d9b700 1 -- 172.21.15.62:0/1475299937 >> v2:172.21.15.159:3300/0 conn(0x7f3c2817dfe0 msgr2=0x7f3c280683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:09.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c25d9b700 1 --2- 172.21.15.62:0/1475299937 >> v2:172.21.15.159:3300/0 conn(0x7f3c2817dfe0 0x7f3c280683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.433 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c25d9b700 1 -- 172.21.15.62:0/1475299937 >> v1:172.21.15.93:6789/0 conn(0x7f3c2817f260 legacy=0x7f3c28084010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c2559a700 1 -- 172.21.15.62:0/1475299937 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885033327 0 0) 0x7f3c2806a2a0 con 0x7f3c2817f260 2022-09-17T10:28:09.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c25d9b700 1 -- 172.21.15.62:0/1475299937 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c28068ff0 con 0x7f3c2817e3c0 2022-09-17T10:28:09.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c25d9b700 1 --2- 172.21.15.62:0/1475299937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817e3c0 0x7f3c28069db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3c1c009810 tx=0x7f3c1c009060).ready entity=mon.1 client_cookie=22a646421a04bbeb server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.434 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c2559a700 1 -- 172.21.15.62:0/1475299937 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c005880 con 0x7f3c2817e3c0 2022-09-17T10:28:09.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c2559a700 1 -- 172.21.15.62:0/1475299937 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0059e0 con 0x7f3c2817e3c0 2022-09-17T10:28:09.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c2559a700 1 -- 172.21.15.62:0/1475299937 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c005d60 con 0x7f3c2817e3c0 2022-09-17T10:28:09.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/1475299937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817e3c0 msgr2=0x7f3c28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.435 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.426+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/1475299937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817e3c0 0x7f3c28069db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3c1c009810 tx=0x7f3c1c009060).stop 2022-09-17T10:28:09.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.427+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/1475299937 shutdown_connections 2022-09-17T10:28:09.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.427+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/1475299937 >> v2:172.21.15.159:3300/0 conn(0x7f3c2817dfe0 0x7f3c280683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.427+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/1475299937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817e3c0 0x7f3c28069db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.427+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/1475299937 >> 172.21.15.62:0/1475299937 conn(0x7f3c28062a40 msgr2=0x7f3c280f2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:09.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.427+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/1475299937 shutdown_connections 2022-09-17T10:28:09.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.427+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/1475299937 wait complete. 2022-09-17T10:28:09.438 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.428+0000 7f3c2ccb1700 1 Processor -- start 2022-09-17T10:28:09.439 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.428+0000 7f3c2ccb1700 1 -- start start 2022-09-17T10:28:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2ccb1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c2817dfe0 0x7f3c2818ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2ccb1700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c2817e3c0 0x7f3c28180920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2ccb1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817f260 0x7f3c28165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2ccb1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2817fbf0 con 0x7f3c2817dfe0 2022-09-17T10:28:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2ccb1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281903f0 con 0x7f3c2817f260 2022-09-17T10:28:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2ccb1700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2818f560 con 0x7f3c2817e3c0 2022-09-17T10:28:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c2817dfe0 0x7f3c2818ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c2817dfe0 0x7f3c2818ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50122/0 (socket says 172.21.15.62:50122) 2022-09-17T10:28:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2659c700 1 -- 172.21.15.62:0/3549195011 learned_addr learned my addr 172.21.15.62:0/3549195011 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c25d9b700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c2817e3c0 0x7f3c28180920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c26d9d700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817f260 0x7f3c28165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2659c700 1 -- 172.21.15.62:0/3549195011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c2817e3c0 msgr2=0x7f3c28180920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2659c700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c2817e3c0 0x7f3c28180920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2659c700 1 -- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817f260 msgr2=0x7f3c28165fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.429+0000 7f3c2659c700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817f260 0x7f3c28165fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.430+0000 7f3c2659c700 1 -- 172.21.15.62:0/3549195011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009300 con 0x7f3c2817dfe0 2022-09-17T10:28:09.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.430+0000 7f3c2659c700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c2817dfe0 0x7f3c2818ff00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f3c1800e900 tx=0x7f3c18009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.430+0000 7f3c167fc700 1 -- 172.21.15.62:0/3549195011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800c640 con 0x7f3c2817dfe0 2022-09-17T10:28:09.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.430+0000 7f3c167fc700 1 -- 172.21.15.62:0/3549195011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800c7a0 con 0x7f3c2817dfe0 2022-09-17T10:28:09.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.430+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2818f840 con 0x7f3c2817dfe0 2022-09-17T10:28:09.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.430+0000 7f3c167fc700 1 -- 172.21.15.62:0/3549195011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800cb20 con 0x7f3c2817dfe0 2022-09-17T10:28:09.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.430+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c28180120 con 0x7f3c2817dfe0 2022-09-17T10:28:09.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.431+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2806bf40 con 0x7f3c2817dfe0 2022-09-17T10:28:09.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.431+0000 7f3c167fc700 1 -- 172.21.15.62:0/3549195011 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3c18022070 con 0x7f3c2817dfe0 2022-09-17T10:28:09.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.432+0000 7f3c167fc700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c0408ba40 0x7f3c0408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.432+0000 7f3c167fc700 1 -- 172.21.15.62:0/3549195011 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3c180b0cb0 con 0x7f3c2817dfe0 2022-09-17T10:28:09.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.432+0000 7f3c25d9b700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c0408ba40 0x7f3c0408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.433+0000 7f3c25d9b700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c0408ba40 0x7f3c0408df00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3c2817e830 tx=0x7f3c1c016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.436+0000 7f3c167fc700 1 -- 172.21.15.62:0/3549195011 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f3c18081970 con 0x7f3c2817dfe0 2022-09-17T10:28:09.616 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.607+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c280692d0 con 0x7f3c2817dfe0 2022-09-17T10:28:09.617 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.608+0000 7f3c167fc700 1 -- 172.21.15.62:0/3549195011 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7f3c18016030 con 0x7f3c2817dfe0 2022-09-17T10:28:09.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:09.619 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:28:09.621 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c0408ba40 msgr2=0x7f3c0408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c0408ba40 0x7f3c0408df00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3c2817e830 tx=0x7f3c1c016000).stop 2022-09-17T10:28:09.622 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c2817dfe0 msgr2=0x7f3c2818ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c2817dfe0 0x7f3c2818ff00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f3c1800e900 tx=0x7f3c18009060).stop 2022-09-17T10:28:09.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 shutdown_connections 2022-09-17T10:28:09.624 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c0408ba40 0x7f3c0408df00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.624 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c2817f260 0x7f3c28165fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.625 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c2817dfe0 0x7f3c2818ff00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.625 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 --2- 172.21.15.62:0/3549195011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c2817e3c0 0x7f3c28180920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.626 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 >> 172.21.15.62:0/3549195011 conn(0x7f3c28062a40 msgr2=0x7f3c28069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:09.626 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 shutdown_connections 2022-09-17T10:28:09.627 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.610+0000 7f3c2ccb1700 1 -- 172.21.15.62:0/3549195011 wait complete. 2022-09-17T10:28:09.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-09-17T10:27:32.392964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-09-17T10:27:35.474566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-09-17T10:27:40.468667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-09-17T10:27:41.769803+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-09-17T10:27:44.846733+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-09-17T10:28:09.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-09-17T10:28:09.754 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.752+0000 7faa13fff700 1 Processor -- start 2022-09-17T10:28:09.755 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.752+0000 7faa13fff700 1 -- start start 2022-09-17T10:28:09.776 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.753+0000 7faa13fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faa1415a2e0 0x7faa1417e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.753+0000 7faa13fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faa1417eed0 0x7faa140b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.778 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.753+0000 7faa13fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa140b7900 con 0x7faa140b8e90 2022-09-17T10:28:09.778 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.753+0000 7faa13fff700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa140ef220 con 0x7faa1417eed0 2022-09-17T10:28:09.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.753+0000 7faa13fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa140b7be0 con 0x7faa1415a2e0 2022-09-17T10:28:09.780 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa137fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faa140b8e90 0x7faa14181ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57808/0 (socket says 172.21.15.62:57808) 2022-09-17T10:28:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa137fe700 1 -- 172.21.15.62:0/2951987759 learned_addr learned my addr 172.21.15.62:0/2951987759 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa127fc700 1 --2- 172.21.15.62:0/2951987759 >> v2:172.21.15.93:3300/0 conn(0x7faa1417eed0 0x7faa140b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa12ffd700 1 --2- 172.21.15.62:0/2951987759 >> v2:172.21.15.159:3300/0 conn(0x7faa1415a2e0 0x7faa1417e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463174210 0 0) 0x7faa140b7900 con 0x7faa140b8e90 2022-09-17T10:28:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f40033f0 con 0x7faa140b8e90 2022-09-17T10:28:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1364614111 0 0) 0x7fa9f40033f0 con 0x7faa140b8e90 2022-09-17T10:28:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 >> v2:172.21.15.159:3300/0 conn(0x7faa1415a2e0 msgr2=0x7faa1417e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 --2- 172.21.15.62:0/2951987759 >> v2:172.21.15.159:3300/0 conn(0x7faa1415a2e0 0x7faa1417e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 >> v2:172.21.15.93:3300/0 conn(0x7faa1417eed0 msgr2=0x7faa140b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 --2- 172.21.15.62:0/2951987759 >> v2:172.21.15.93:3300/0 conn(0x7faa1417eed0 0x7faa140b89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa140b7ec0 con 0x7faa140b8e90 2022-09-17T10:28:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7faa040017f0 con 0x7faa140b8e90 2022-09-17T10:28:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 >> v1:172.21.15.62:6789/0 conn(0x7faa140b8e90 legacy=0x7faa14181ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f4003930 0x7fa9f4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f4004690 0x7fa9f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4005000 0x7fa9f400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140ef220 con 0x7fa9f4004690 2022-09-17T10:28:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140b7be0 con 0x7fa9f4005000 2022-09-17T10:28:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f400bdd0 con 0x7fa9f4003930 2022-09-17T10:28:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa127fc700 1 --2- 172.21.15.62:0/2951987759 >> v2:172.21.15.93:3300/0 conn(0x7faa1417eed0 0x7faa140b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:28:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa12ffd700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f4003930 0x7fa9f4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa127fc700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f4004690 0x7fa9f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.754+0000 7faa137fe700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4005000 0x7fa9f400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa127fc700 1 -- 172.21.15.62:0/2951987759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f4003930 msgr2=0x7fa9f4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa127fc700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f4003930 0x7fa9f4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa127fc700 1 -- 172.21.15.62:0/2951987759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4005000 msgr2=0x7fa9f400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa127fc700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4005000 0x7fa9f400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa137fe700 1 -- 172.21.15.62:0/2951987759 reap_dead start 2022-09-17T10:28:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa127fc700 1 -- 172.21.15.62:0/2951987759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f40033f0 con 0x7fa9f4004690 2022-09-17T10:28:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa127fc700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f4004690 0x7fa9f4004b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fa9fc006d80 tx=0x7fa9fc009060).ready entity=mon.0 client_cookie=426d98384893f2ec server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0095c0 con 0x7fa9f4004690 2022-09-17T10:28:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc00e710 con 0x7fa9f4004690 2022-09-17T10:28:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa11ffb700 1 -- 172.21.15.62:0/2951987759 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc00ea90 con 0x7fa9f4004690 2022-09-17T10:28:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa13fff700 1 -- 172.21.15.62:0/2951987759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f4004690 msgr2=0x7fa9f4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa13fff700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f4004690 0x7fa9f4004b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fa9fc006d80 tx=0x7fa9fc009060).stop 2022-09-17T10:28:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa13fff700 1 -- 172.21.15.62:0/2951987759 shutdown_connections 2022-09-17T10:28:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa13fff700 1 --2- 172.21.15.62:0/2951987759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f4004690 0x7fa9f4004b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa13fff700 1 -- 172.21.15.62:0/2951987759 >> 172.21.15.62:0/2951987759 conn(0x7faa1405d9a0 msgr2=0x7faa1405ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa13fff700 1 -- 172.21.15.62:0/2951987759 shutdown_connections 2022-09-17T10:28:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.755+0000 7faa13fff700 1 -- 172.21.15.62:0/2951987759 wait complete. 2022-09-17T10:28:09.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.757+0000 7faa13fff700 1 Processor -- start 2022-09-17T10:28:09.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.757+0000 7faa13fff700 1 -- start start 2022-09-17T10:28:09.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa13fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4004690 0x7faa14174cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa13fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa140bcc20 0x7faa14152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa14152d50 0x7faa141531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa13fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa141751e0 con 0x7faa14152d50 2022-09-17T10:28:09.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa13fff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa141523d0 con 0x7fa9f4004690 2022-09-17T10:28:09.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa13fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140bbbc0 con 0x7faa140bcc20 2022-09-17T10:28:09.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa14152d50 0x7faa141531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa14152d50 0x7faa141531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50142/0 (socket says 172.21.15.62:50142) 2022-09-17T10:28:09.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa137fe700 1 -- 172.21.15.62:0/3624362336 learned_addr learned my addr 172.21.15.62:0/3624362336 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:09.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa12ffd700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4004690 0x7faa14174cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa137fe700 1 -- 172.21.15.62:0/3624362336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa140bcc20 msgr2=0x7faa14152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa127fc700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa140bcc20 0x7faa14152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa137fe700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa140bcc20 0x7faa14152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa137fe700 1 -- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4004690 msgr2=0x7faa14174cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa137fe700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4004690 0x7faa14174cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa137fe700 1 -- 172.21.15.62:0/3624362336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa140bbea0 con 0x7faa14152d50 2022-09-17T10:28:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.758+0000 7faa12ffd700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4004690 0x7faa14174cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.759+0000 7faa137fe700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa14152d50 0x7faa141531d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7faa140efca0 tx=0x7faa04002210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.759+0000 7faa0affd700 1 -- 172.21.15.62:0/3624362336 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400f670 con 0x7faa14152d50 2022-09-17T10:28:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.759+0000 7faa0affd700 1 -- 172.21.15.62:0/3624362336 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0400f7f0 con 0x7faa14152d50 2022-09-17T10:28:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.759+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa14151aa0 con 0x7faa14152d50 2022-09-17T10:28:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.759+0000 7faa0affd700 1 -- 172.21.15.62:0/3624362336 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400fbb0 con 0x7faa14152d50 2022-09-17T10:28:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.759+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa14152060 con 0x7faa14152d50 2022-09-17T10:28:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.760+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1406be90 con 0x7faa14152d50 2022-09-17T10:28:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.760+0000 7faa0affd700 1 -- 172.21.15.62:0/3624362336 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7faa0401b030 con 0x7faa14152d50 2022-09-17T10:28:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.761+0000 7faa0affd700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa9f808ba40 0x7fa9f808df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.761+0000 7faa0affd700 1 -- 172.21.15.62:0/3624362336 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7faa040afe40 con 0x7faa14152d50 2022-09-17T10:28:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.761+0000 7faa12ffd700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa9f808ba40 0x7fa9f808df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.761+0000 7faa12ffd700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa9f808ba40 0x7fa9f808df00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7faa0c006c40 tx=0x7faa0c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.765+0000 7faa0affd700 1 -- 172.21.15.62:0/3624362336 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7faa04080b00 con 0x7faa14152d50 2022-09-17T10:28:09.939 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.937+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7faa140b81a0 con 0x7faa14152d50 2022-09-17T10:28:09.939 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.937+0000 7faa0affd700 1 -- 172.21.15.62:0/3624362336 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7faa04019020 con 0x7faa14152d50 2022-09-17T10:28:09.940 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2022-09-17T10:28:09.941 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa9f808ba40 msgr2=0x7fa9f808df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.942 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa9f808ba40 0x7fa9f808df00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7faa0c006c40 tx=0x7faa0c008040).stop 2022-09-17T10:28:09.942 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa14152d50 msgr2=0x7faa141531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:09.942 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa14152d50 0x7faa141531d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7faa140efca0 tx=0x7faa04002210).stop 2022-09-17T10:28:09.942 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 shutdown_connections 2022-09-17T10:28:09.943 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fa9f808ba40 0x7fa9f808df00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.943 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9f4004690 0x7faa14174cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.943 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa14152d50 0x7faa141531d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.943 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 --2- 172.21.15.62:0/3624362336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa140bcc20 0x7faa14152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:09.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 >> 172.21.15.62:0/3624362336 conn(0x7faa1405d9a0 msgr2=0x7faa140e3620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:09.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 shutdown_connections 2022-09-17T10:28:09.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:09.939+0000 7faa13fff700 1 -- 172.21.15.62:0/3624362336 wait complete. 2022-09-17T10:28:09.953 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-17T10:28:10.075 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.073+0000 7f584acb7700 1 Processor -- start 2022-09-17T10:28:10.075 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.073+0000 7f584acb7700 1 -- start start 2022-09-17T10:28:10.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.074+0000 7f584acb7700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f584417de70 0x7f58440b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.074+0000 7f584acb7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58440b7730 con 0x7f584417da90 2022-09-17T10:28:10.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.074+0000 7f584acb7700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58440ec220 con 0x7f58440e5440 2022-09-17T10:28:10.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.074+0000 7f584acb7700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58440ec500 con 0x7f584417de70 2022-09-17T10:28:10.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.074+0000 7f5849cb5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f584417da90 0x7f58440e4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57816/0 (socket says 172.21.15.62:57816) 2022-09-17T10:28:10.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.074+0000 7f5849cb5700 1 -- 172.21.15.62:0/1877516173 learned_addr learned my addr 172.21.15.62:0/1877516173 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:10.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.074+0000 7f584a4b6700 1 --2- 172.21.15.62:0/1877516173 >> v2:172.21.15.159:3300/0 conn(0x7f584417de70 0x7f58440b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.074+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620878310 0 0) 0x7f58440b7730 con 0x7f584417da90 2022-09-17T10:28:10.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58300033f0 con 0x7f584417da90 2022-09-17T10:28:10.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2767309619 0 0) 0x7f58300033f0 con 0x7f584417da90 2022-09-17T10:28:10.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 >> v2:172.21.15.159:3300/0 conn(0x7f584417de70 msgr2=0x7f58440b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:10.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 --2- 172.21.15.62:0/1877516173 >> v2:172.21.15.159:3300/0 conn(0x7f584417de70 0x7f58440b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 >> v1:172.21.15.93:6789/0 conn(0x7f58440e5440 legacy=0x7f58440b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440ec7e0 con 0x7f584417da90 2022-09-17T10:28:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f583c0017f0 con 0x7f584417da90 2022-09-17T10:28:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 >> v1:172.21.15.62:6789/0 conn(0x7f584417da90 legacy=0x7f58440e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58300038e0 0x7f5830003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5830004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5830005000 0x7f583000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440ec500 con 0x7f5830004690 2022-09-17T10:28:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583000be50 con 0x7f5830005000 2022-09-17T10:28:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583000c010 con 0x7f58300038e0 2022-09-17T10:28:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f58494b4700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5830004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f5849cb5700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58300038e0 0x7f5830003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f584a4b6700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5830005000 0x7f583000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f58494b4700 1 -- 172.21.15.62:0/1877516173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58300038e0 msgr2=0x7f5830003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f58494b4700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58300038e0 0x7f5830003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f58494b4700 1 -- 172.21.15.62:0/1877516173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5830005000 msgr2=0x7f583000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f58494b4700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5830005000 0x7f583000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f584a4b6700 1 -- 172.21.15.62:0/1877516173 reap_dead start 2022-09-17T10:28:10.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f58494b4700 1 -- 172.21.15.62:0/1877516173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58300033f0 con 0x7f5830004690 2022-09-17T10:28:10.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.075+0000 7f58494b4700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5830004b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f58380017e0 tx=0x7f5838007b90).ready entity=mon.0 client_cookie=ff8cf6c08107ad69 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838007ea0 con 0x7f5830004690 2022-09-17T10:28:10.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5838012400 con 0x7f5830004690 2022-09-17T10:28:10.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f5848cb3700 1 -- 172.21.15.62:0/1877516173 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380127c0 con 0x7f5830004690 2022-09-17T10:28:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f584acb7700 1 -- 172.21.15.62:0/1877516173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 msgr2=0x7f5830004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f584acb7700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5830004b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f58380017e0 tx=0x7f5838007b90).stop 2022-09-17T10:28:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f584acb7700 1 -- 172.21.15.62:0/1877516173 shutdown_connections 2022-09-17T10:28:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f584acb7700 1 --2- 172.21.15.62:0/1877516173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5830004b10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f584acb7700 1 -- 172.21.15.62:0/1877516173 >> 172.21.15.62:0/1877516173 conn(0x7f584405d9a0 msgr2=0x7f584405ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:10.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f584acb7700 1 -- 172.21.15.62:0/1877516173 shutdown_connections 2022-09-17T10:28:10.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.076+0000 7f584acb7700 1 -- 172.21.15.62:0/1877516173 wait complete. 2022-09-17T10:28:10.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.078+0000 7f584acb7700 1 Processor -- start 2022-09-17T10:28:10.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.078+0000 7f584acb7700 1 -- start start 2022-09-17T10:28:10.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f584acb7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5844159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f584acb7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5844159730 0x7f5844159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f584acb7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f584415a310 0x7f584418f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.100 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f584acb7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584418ee30 con 0x7f5830004690 2022-09-17T10:28:10.100 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f584acb7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440bc860 con 0x7f584415a310 2022-09-17T10:28:10.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f584acb7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440bb970 con 0x7f5844159730 2022-09-17T10:28:10.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5844159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5844159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50154/0 (socket says 172.21.15.62:50154) 2022-09-17T10:28:10.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 -- 172.21.15.62:0/3203983138 learned_addr learned my addr 172.21.15.62:0/3203983138 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:10.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f584a4b6700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f584415a310 0x7f584418f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f58494b4700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5844159730 0x7f5844159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 -- 172.21.15.62:0/3203983138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5844159730 msgr2=0x7f5844159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5844159730 0x7f5844159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 -- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f584415a310 msgr2=0x7f584418f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.104 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f584415a310 0x7f584418f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 -- 172.21.15.62:0/3203983138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440bbc50 con 0x7f5830004690 2022-09-17T10:28:10.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5849cb5700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5844159240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f583c007770 tx=0x7f583c001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.105 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5841ffb700 1 -- 172.21.15.62:0/3203983138 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00f870 con 0x7f5830004690 2022-09-17T10:28:10.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5841ffb700 1 -- 172.21.15.62:0/3203983138 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c00f9d0 con 0x7f5830004690 2022-09-17T10:28:10.106 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58440bbf30 con 0x7f5830004690 2022-09-17T10:28:10.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.079+0000 7f5841ffb700 1 -- 172.21.15.62:0/3203983138 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00fd50 con 0x7f5830004690 2022-09-17T10:28:10.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.080+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58440bc4f0 con 0x7f5830004690 2022-09-17T10:28:10.107 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.081+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58440bc6b0 con 0x7f5830004690 2022-09-17T10:28:10.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.081+0000 7f5841ffb700 1 -- 172.21.15.62:0/3203983138 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f583c01b030 con 0x7f5830004690 2022-09-17T10:28:10.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.082+0000 7f5841ffb700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f582408ba40 0x7f582408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.082+0000 7f5841ffb700 1 -- 172.21.15.62:0/3203983138 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f583c0b0370 con 0x7f5830004690 2022-09-17T10:28:10.108 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.082+0000 7f58494b4700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f582408ba40 0x7f582408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.083+0000 7f58494b4700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f582408ba40 0x7f582408df00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f58440e7ec0 tx=0x7f5838017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.109 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.086+0000 7f5841ffb700 1 -- 172.21.15.62:0/3203983138 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f583c081030 con 0x7f5830004690 2022-09-17T10:28:10.262 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.259+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f584406be90 con 0x7f5830004690 2022-09-17T10:28:10.263 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.260+0000 7f5841ffb700 1 -- 172.21.15.62:0/3203983138 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f583c019030 con 0x7f5830004690 2022-09-17T10:28:10.264 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2022-09-17T10:28:10.266 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f582408ba40 msgr2=0x7f582408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.267 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f582408ba40 0x7f582408df00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f58440e7ec0 tx=0x7f5838017000).stop 2022-09-17T10:28:10.267 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 msgr2=0x7f5844159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.268 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5844159240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f583c007770 tx=0x7f583c001d90).stop 2022-09-17T10:28:10.268 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 shutdown_connections 2022-09-17T10:28:10.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f582408ba40 0x7f582408df00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.269 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f584415a310 0x7f584418f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5830004690 0x7f5844159240 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.270 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 --2- 172.21.15.62:0/3203983138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5844159730 0x7f5844159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 >> 172.21.15.62:0/3203983138 conn(0x7f584405d9a0 msgr2=0x7f58440ee7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:10.271 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 shutdown_connections 2022-09-17T10:28:10.272 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.262+0000 7f584acb7700 1 -- 172.21.15.62:0/3203983138 wait complete. 2022-09-17T10:28:10.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-09-17T10:28:10.397 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.395+0000 7f2e913b2700 1 Processor -- start 2022-09-17T10:28:10.397 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.395+0000 7f2e913b2700 1 -- start start 2022-09-17T10:28:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e913b2700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2e8c1762d0 0x7f2e8c1766b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e913b2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e8c17eed0 0x7f2e8c0ed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e913b2700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c17da40 con 0x7f2e8c0c4510 2022-09-17T10:28:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e913b2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c085d90 con 0x7f2e8c17eed0 2022-09-17T10:28:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e913b2700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c086070 con 0x7f2e8c1762d0 2022-09-17T10:28:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e8c17eed0 0x7f2e8c0ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e8c17eed0 0x7f2e8c0ed440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50166/0 (socket says 172.21.15.62:50166) 2022-09-17T10:28:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8b7fe700 1 -- 172.21.15.62:0/1381044716 learned_addr learned my addr 172.21.15.62:0/1381044716 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8affd700 1 --2- 172.21.15.62:0/1381044716 >> v2:172.21.15.159:3300/0 conn(0x7f2e8c1762d0 0x7f2e8c1766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8b7fe700 1 -- 172.21.15.62:0/1381044716 >> v2:172.21.15.159:3300/0 conn(0x7f2e8c1762d0 msgr2=0x7f2e8c1766b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8b7fe700 1 --2- 172.21.15.62:0/1381044716 >> v2:172.21.15.159:3300/0 conn(0x7f2e8c1762d0 0x7f2e8c1766b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e89ffb700 1 -- 172.21.15.62:0/1381044716 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783843334 0 0) 0x7f2e8c17da40 con 0x7f2e8c0c4510 2022-09-17T10:28:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8b7fe700 1 -- 172.21.15.62:0/1381044716 >> v1:172.21.15.93:6789/0 conn(0x7f2e8c0c4510 legacy=0x7f2e8c17e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8b7fe700 1 -- 172.21.15.62:0/1381044716 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c17dce0 con 0x7f2e8c17eed0 2022-09-17T10:28:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.396+0000 7f2e8affd700 1 --2- 172.21.15.62:0/1381044716 >> v2:172.21.15.159:3300/0 conn(0x7f2e8c1762d0 0x7f2e8c1766b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e8b7fe700 1 --2- 172.21.15.62:0/1381044716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c17eed0 0x7f2e8c0ed440 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2e8c086fb0 tx=0x7f2e84009840).ready entity=mon.0 client_cookie=1a79a1fb650ce202 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e89ffb700 1 -- 172.21.15.62:0/1381044716 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400e070 con 0x7f2e8c17eed0 2022-09-17T10:28:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e89ffb700 1 -- 172.21.15.62:0/1381044716 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400ba50 con 0x7f2e8c17eed0 2022-09-17T10:28:10.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e89ffb700 1 -- 172.21.15.62:0/1381044716 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400bdd0 con 0x7f2e8c17eed0 2022-09-17T10:28:10.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e913b2700 1 -- 172.21.15.62:0/1381044716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c17eed0 msgr2=0x7f2e8c0ed440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.406 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e913b2700 1 --2- 172.21.15.62:0/1381044716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c17eed0 0x7f2e8c0ed440 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2e8c086fb0 tx=0x7f2e84009840).stop 2022-09-17T10:28:10.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e913b2700 1 -- 172.21.15.62:0/1381044716 shutdown_connections 2022-09-17T10:28:10.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e913b2700 1 --2- 172.21.15.62:0/1381044716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c17eed0 0x7f2e8c0ed440 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e913b2700 1 --2- 172.21.15.62:0/1381044716 >> v2:172.21.15.159:3300/0 conn(0x7f2e8c1762d0 0x7f2e8c1766b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.407 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e913b2700 1 -- 172.21.15.62:0/1381044716 >> 172.21.15.62:0/1381044716 conn(0x7f2e8c0f2aa0 msgr2=0x7f2e8c0f2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:10.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e913b2700 1 -- 172.21.15.62:0/1381044716 shutdown_connections 2022-09-17T10:28:10.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.397+0000 7f2e913b2700 1 -- 172.21.15.62:0/1381044716 wait complete. 2022-09-17T10:28:10.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.399+0000 7f2e913b2700 1 Processor -- start 2022-09-17T10:28:10.408 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.399+0000 7f2e913b2700 1 -- start start 2022-09-17T10:28:10.412 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e913b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c0c4510 0x7f2e8c16bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.413 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e913b2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e8c1762d0 0x7f2e8c16bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.413 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e913b2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c17eed0 0x7f2e8c069040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.413 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e913b2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c068310 con 0x7f2e8c0c4510 2022-09-17T10:28:10.413 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e913b2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c068bb0 con 0x7f2e8c1762d0 2022-09-17T10:28:10.413 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e913b2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0ec750 con 0x7f2e8c17eed0 2022-09-17T10:28:10.414 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c0c4510 0x7f2e8c16bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.414 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c0c4510 0x7f2e8c16bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50178/0 (socket says 172.21.15.62:50178) 2022-09-17T10:28:10.414 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 -- 172.21.15.62:0/2191407527 learned_addr learned my addr 172.21.15.62:0/2191407527 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:10.414 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8a7fc700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e8c1762d0 0x7f2e8c16bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.415 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 -- 172.21.15.62:0/2191407527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c17eed0 msgr2=0x7f2e8c069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.415 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c17eed0 0x7f2e8c069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:10.415 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 -- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e8c1762d0 msgr2=0x7f2e8c16bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.415 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e8c1762d0 0x7f2e8c16bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.416 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 -- 172.21.15.62:0/2191407527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009ae0 con 0x7f2e8c0c4510 2022-09-17T10:28:10.416 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8a7fc700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e8c1762d0 0x7f2e8c16bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:10.416 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e8affd700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c0c4510 0x7f2e8c16bae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f2e7c00d860 tx=0x7f2e7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.416 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e82ffd700 1 -- 172.21.15.62:0/2191407527 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c011590 con 0x7f2e8c0c4510 2022-09-17T10:28:10.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e82ffd700 1 -- 172.21.15.62:0/2191407527 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c0116f0 con 0x7f2e8c0c4510 2022-09-17T10:28:10.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.400+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c0eca30 con 0x7f2e8c0c4510 2022-09-17T10:28:10.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.401+0000 7f2e82ffd700 1 -- 172.21.15.62:0/2191407527 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c011a70 con 0x7f2e8c0c4510 2022-09-17T10:28:10.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.401+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c068840 con 0x7f2e8c0c4510 2022-09-17T10:28:10.417 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.402+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c068e90 con 0x7f2e8c0c4510 2022-09-17T10:28:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.402+0000 7f2e82ffd700 1 -- 172.21.15.62:0/2191407527 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f2e7c01c460 con 0x7f2e8c0c4510 2022-09-17T10:28:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.403+0000 7f2e82ffd700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2e7008ba40 0x7f2e7008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.403+0000 7f2e82ffd700 1 -- 172.21.15.62:0/2191407527 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f2e7c0b0980 con 0x7f2e8c0c4510 2022-09-17T10:28:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.403+0000 7f2e8a7fc700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2e7008ba40 0x7f2e7008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.419 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.403+0000 7f2e8a7fc700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2e7008ba40 0x7f2e7008df00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2e8c085cc0 tx=0x7f2e74009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.419 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.407+0000 7f2e82ffd700 1 -- 172.21.15.62:0/2191407527 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f2e7c081640 con 0x7f2e8c0c4510 2022-09-17T10:28:10.582 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.580+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e8c17dfc0 con 0x7f2e8c0c4510 2022-09-17T10:28:10.583 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.580+0000 7f2e82ffd700 1 -- 172.21.15.62:0/2191407527 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e7c084c60 con 0x7f2e8c0c4510 2022-09-17T10:28:10.584 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2022-09-17T10:28:10.585 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2e7008ba40 msgr2=0x7f2e7008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2e7008ba40 0x7f2e7008df00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2e8c085cc0 tx=0x7f2e74009040).stop 2022-09-17T10:28:10.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c0c4510 msgr2=0x7f2e8c16bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c0c4510 0x7f2e8c16bae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f2e7c00d860 tx=0x7f2e7c008040).stop 2022-09-17T10:28:10.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 shutdown_connections 2022-09-17T10:28:10.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f2e7008ba40 0x7f2e7008df00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c17eed0 0x7f2e8c069040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:10.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e8c0c4510 0x7f2e8c16bae0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.589 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 --2- 172.21.15.62:0/2191407527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e8c1762d0 0x7f2e8c16bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.589 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 >> 172.21.15.62:0/2191407527 conn(0x7f2e8c0f2aa0 msgr2=0x7f2e8c173990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:10.590 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 shutdown_connections 2022-09-17T10:28:10.590 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.582+0000 7f2e913b2700 1 -- 172.21.15.62:0/2191407527 wait complete. 2022-09-17T10:28:10.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-09-17T10:28:10.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.714+0000 7f4851079700 1 Processor -- start 2022-09-17T10:28:10.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.714+0000 7f4851079700 1 -- start start 2022-09-17T10:28:10.724 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f4851079700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f484c1751b0 0x7f484c180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f4851079700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f484c175590 0x7f484c180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f4851079700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c0c6dd0 con 0x7f484c181050 2022-09-17T10:28:10.725 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f4851079700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c0f10e0 con 0x7f484c1751b0 2022-09-17T10:28:10.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f4851079700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c0f0660 con 0x7f484c175590 2022-09-17T10:28:10.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f484c1751b0 0x7f484c180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.726 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f484c1751b0 0x7f484c180670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50184/0 (socket says 172.21.15.62:50184) 2022-09-17T10:28:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484ad9d700 1 -- 172.21.15.62:0/765417422 learned_addr learned my addr 172.21.15.62:0/765417422 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484a59c700 1 --2- 172.21.15.62:0/765417422 >> v2:172.21.15.93:3300/0 conn(0x7f484c175590 0x7f484c180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484ad9d700 1 -- 172.21.15.62:0/765417422 >> v2:172.21.15.93:3300/0 conn(0x7f484c175590 msgr2=0x7f484c180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484ad9d700 1 --2- 172.21.15.62:0/765417422 >> v2:172.21.15.93:3300/0 conn(0x7f484c175590 0x7f484c180b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484ad9d700 1 -- 172.21.15.62:0/765417422 >> v1:172.21.15.93:6789/0 conn(0x7f484c181050 legacy=0x7f484c181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484ad9d700 1 -- 172.21.15.62:0/765417422 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c1801e0 con 0x7f484c1751b0 2022-09-17T10:28:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f484ad9d700 1 --2- 172.21.15.62:0/765417422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c1751b0 0x7f484c180670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f484c085780 tx=0x7f483c0090f0).ready entity=mon.0 client_cookie=131481660224eeb5 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f4849d9b700 1 -- 172.21.15.62:0/765417422 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00b600 con 0x7f484c1751b0 2022-09-17T10:28:10.729 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f4849d9b700 1 -- 172.21.15.62:0/765417422 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c00b760 con 0x7f484c1751b0 2022-09-17T10:28:10.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.716+0000 7f4849d9b700 1 -- 172.21.15.62:0/765417422 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00bb00 con 0x7f484c1751b0 2022-09-17T10:28:10.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.717+0000 7f4851079700 1 -- 172.21.15.62:0/765417422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c1751b0 msgr2=0x7f484c180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.717+0000 7f4851079700 1 --2- 172.21.15.62:0/765417422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c1751b0 0x7f484c180670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f484c085780 tx=0x7f483c0090f0).stop 2022-09-17T10:28:10.730 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.717+0000 7f4851079700 1 -- 172.21.15.62:0/765417422 shutdown_connections 2022-09-17T10:28:10.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.717+0000 7f4851079700 1 --2- 172.21.15.62:0/765417422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c1751b0 0x7f484c180670 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0x7f484c085780 tx=0x7f483c0090f0).stop 2022-09-17T10:28:10.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.717+0000 7f4851079700 1 --2- 172.21.15.62:0/765417422 >> v2:172.21.15.93:3300/0 conn(0x7f484c175590 0x7f484c180b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.717+0000 7f4851079700 1 -- 172.21.15.62:0/765417422 >> 172.21.15.62:0/765417422 conn(0x7f484c06a170 msgr2=0x7f484c0f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:10.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.717+0000 7f4851079700 1 -- 172.21.15.62:0/765417422 shutdown_connections 2022-09-17T10:28:10.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.717+0000 7f4851079700 1 -- 172.21.15.62:0/765417422 wait complete. 2022-09-17T10:28:10.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.718+0000 7f4851079700 1 Processor -- start 2022-09-17T10:28:10.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.718+0000 7f4851079700 1 -- start start 2022-09-17T10:28:10.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.719+0000 7f4851079700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f484c175590 0x7f484c086c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.719+0000 7f4851079700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f484c181050 0x7f484c1929b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.719+0000 7f4851079700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c165df0 0x7f484c18fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.719+0000 7f4851079700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0858c0 con 0x7f484c165df0 2022-09-17T10:28:10.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.719+0000 7f4851079700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c085ba0 con 0x7f484c175590 2022-09-17T10:28:10.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.719+0000 7f4851079700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c085e80 con 0x7f484c181050 2022-09-17T10:28:10.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c165df0 0x7f484c18fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484ad9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f484c175590 0x7f484c086c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c165df0 0x7f484c18fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50190/0 (socket says 172.21.15.62:50190) 2022-09-17T10:28:10.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 -- 172.21.15.62:0/2165514764 learned_addr learned my addr 172.21.15.62:0/2165514764 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:10.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484a59c700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f484c181050 0x7f484c1929b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 -- 172.21.15.62:0/2165514764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f484c181050 msgr2=0x7f484c1929b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f484c181050 0x7f484c1929b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 -- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f484c175590 msgr2=0x7f484c086c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f484c175590 0x7f484c086c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 -- 172.21.15.62:0/2165514764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c009370 con 0x7f484c165df0 2022-09-17T10:28:10.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f484b59e700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c165df0 0x7f484c18fde0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f484400c7c0 tx=0x7f4844001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f4842ffd700 1 -- 172.21.15.62:0/2165514764 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400e4a0 con 0x7f484c165df0 2022-09-17T10:28:10.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f4842ffd700 1 -- 172.21.15.62:0/2165514764 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400e600 con 0x7f484c165df0 2022-09-17T10:28:10.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c086160 con 0x7f484c165df0 2022-09-17T10:28:10.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f4842ffd700 1 -- 172.21.15.62:0/2165514764 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400e980 con 0x7f484c165df0 2022-09-17T10:28:10.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.720+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c086720 con 0x7f484c165df0 2022-09-17T10:28:10.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.721+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c06bf40 con 0x7f484c165df0 2022-09-17T10:28:10.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.722+0000 7f4842ffd700 1 -- 172.21.15.62:0/2165514764 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4844010070 con 0x7f484c165df0 2022-09-17T10:28:10.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.722+0000 7f4842ffd700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f483008ba40 0x7f483008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:10.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.723+0000 7f4842ffd700 1 -- 172.21.15.62:0/2165514764 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f48440affe0 con 0x7f484c165df0 2022-09-17T10:28:10.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.723+0000 7f484ad9d700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f483008ba40 0x7f483008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:10.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.723+0000 7f484ad9d700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f483008ba40 0x7f483008df00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f484c089200 tx=0x7f483c017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:10.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.726+0000 7f4842ffd700 1 -- 172.21.15.62:0/2165514764 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f4844080ca0 con 0x7f484c165df0 2022-09-17T10:28:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.900+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f484c0f0840 con 0x7f484c165df0 2022-09-17T10:28:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.900+0000 7f4842ffd700 1 -- 172.21.15.62:0/2165514764 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48440842c0 con 0x7f484c165df0 2022-09-17T10:28:10.903 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2022-09-17T10:28:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f483008ba40 msgr2=0x7f483008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f483008ba40 0x7f483008df00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f484c089200 tx=0x7f483c017000).stop 2022-09-17T10:28:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c165df0 msgr2=0x7f484c18fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c165df0 0x7f484c18fde0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f484400c7c0 tx=0x7f4844001510).stop 2022-09-17T10:28:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 shutdown_connections 2022-09-17T10:28:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f483008ba40 0x7f483008df00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f484c175590 0x7f484c086c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f484c165df0 0x7f484c18fde0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 --2- 172.21.15.62:0/2165514764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f484c181050 0x7f484c1929b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.902+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 >> 172.21.15.62:0/2165514764 conn(0x7f484c06a170 msgr2=0x7f484c0842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.903+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 shutdown_connections 2022-09-17T10:28:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:10.903+0000 7f4851079700 1 -- 172.21.15.62:0/2165514764 wait complete. 2022-09-17T10:28:10.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-09-17T10:28:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.034+0000 7f91bb59e700 1 Processor -- start 2022-09-17T10:28:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.034+0000 7f91bb59e700 1 -- start start 2022-09-17T10:28:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.035+0000 7f91bb59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91bc0e5440 0x7f91bc0b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.035+0000 7f91bb59e700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f91bc17de70 0x7f91bc0b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.035+0000 7f91bb59e700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc0b7730 con 0x7f91bc17da90 2022-09-17T10:28:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.035+0000 7f91bb59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc0ec220 con 0x7f91bc0e5440 2022-09-17T10:28:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.035+0000 7f91bb59e700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc0ec500 con 0x7f91bc17de70 2022-09-17T10:28:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.035+0000 7f91b9d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91bc0e5440 0x7f91bc0b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.041 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.035+0000 7f91b9d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91bc0e5440 0x7f91bc0b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50202/0 (socket says 172.21.15.62:50202) 2022-09-17T10:28:11.041 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.035+0000 7f91b9d9b700 1 -- 172.21.15.62:0/3884697189 learned_addr learned my addr 172.21.15.62:0/3884697189 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:11.041 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91bad9d700 1 --2- 172.21.15.62:0/3884697189 >> v2:172.21.15.159:3300/0 conn(0x7f91bc17de70 0x7f91bc0b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.042 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91b9d9b700 1 -- 172.21.15.62:0/3884697189 >> v2:172.21.15.159:3300/0 conn(0x7f91bc17de70 msgr2=0x7f91bc0b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:11.042 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91b9d9b700 1 --2- 172.21.15.62:0/3884697189 >> v2:172.21.15.159:3300/0 conn(0x7f91bc17de70 0x7f91bc0b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.042 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91b9d9b700 1 -- 172.21.15.62:0/3884697189 >> v1:172.21.15.159:6789/0 conn(0x7f91bc17da90 legacy=0x7f91bc0e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91b9d9b700 1 -- 172.21.15.62:0/3884697189 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0ec7e0 con 0x7f91bc0e5440 2022-09-17T10:28:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91b9d9b700 1 --2- 172.21.15.62:0/3884697189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc0e5440 0x7f91bc0b7bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f91bc06a720 tx=0x7f91a40090f0).ready entity=mon.0 client_cookie=f87baf1c1e6004c2 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91b959a700 1 -- 172.21.15.62:0/3884697189 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400b600 con 0x7f91bc0e5440 2022-09-17T10:28:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91b959a700 1 -- 172.21.15.62:0/3884697189 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a400b760 con 0x7f91bc0e5440 2022-09-17T10:28:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.036+0000 7f91b959a700 1 -- 172.21.15.62:0/3884697189 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400bae0 con 0x7f91bc0e5440 2022-09-17T10:28:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.037+0000 7f91bb59e700 1 -- 172.21.15.62:0/3884697189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc0e5440 msgr2=0x7f91bc0b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.037+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3884697189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc0e5440 0x7f91bc0b7bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f91bc06a720 tx=0x7f91a40090f0).stop 2022-09-17T10:28:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.037+0000 7f91bb59e700 1 -- 172.21.15.62:0/3884697189 shutdown_connections 2022-09-17T10:28:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.037+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3884697189 >> v2:172.21.15.159:3300/0 conn(0x7f91bc17de70 0x7f91bc0b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.037+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3884697189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc0e5440 0x7f91bc0b7bc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.037+0000 7f91bb59e700 1 -- 172.21.15.62:0/3884697189 >> 172.21.15.62:0/3884697189 conn(0x7f91bc05d9a0 msgr2=0x7f91bc05ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.037+0000 7f91bb59e700 1 -- 172.21.15.62:0/3884697189 shutdown_connections 2022-09-17T10:28:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.037+0000 7f91bb59e700 1 -- 172.21.15.62:0/3884697189 wait complete. 2022-09-17T10:28:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.038+0000 7f91bb59e700 1 Processor -- start 2022-09-17T10:28:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.038+0000 7f91bb59e700 1 -- start start 2022-09-17T10:28:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bb59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91bc0e5440 0x7f91bc174580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bb59e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91bc17da90 0x7f91bc179590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bb59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc17de70 0x7f91bc179a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bb59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc175b90 con 0x7f91bc17de70 2022-09-17T10:28:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bb59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc175860 con 0x7f91bc0e5440 2022-09-17T10:28:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bb59e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc17a0d0 con 0x7f91bc17da90 2022-09-17T10:28:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc17de70 0x7f91bc179a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc17de70 0x7f91bc179a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50216/0 (socket says 172.21.15.62:50216) 2022-09-17T10:28:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91bad9d700 1 -- 172.21.15.62:0/3893014935 learned_addr learned my addr 172.21.15.62:0/3893014935 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:11.052 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91b9d9b700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91bc17da90 0x7f91bc179590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.052 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.039+0000 7f91ba59c700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91bc0e5440 0x7f91bc174580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.052 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91bad9d700 1 -- 172.21.15.62:0/3893014935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91bc17da90 msgr2=0x7f91bc179590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.052 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91bad9d700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91bc17da90 0x7f91bc179590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91bad9d700 1 -- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91bc0e5440 msgr2=0x7f91bc174580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91bad9d700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91bc0e5440 0x7f91bc174580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91bad9d700 1 -- 172.21.15.62:0/3893014935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4009370 con 0x7f91bc17de70 2022-09-17T10:28:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91bad9d700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc17de70 0x7f91bc179a80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f91ac007f20 tx=0x7f91ac009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91b27fc700 1 -- 172.21.15.62:0/3893014935 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00eca0 con 0x7f91bc17de70 2022-09-17T10:28:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91b27fc700 1 -- 172.21.15.62:0/3893014935 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00ee00 con 0x7f91bc17de70 2022-09-17T10:28:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc17a3b0 con 0x7f91bc17de70 2022-09-17T10:28:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91b27fc700 1 -- 172.21.15.62:0/3893014935 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac014610 con 0x7f91bc17de70 2022-09-17T10:28:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.040+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc17a970 con 0x7f91bc17de70 2022-09-17T10:28:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.041+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc175d00 con 0x7f91bc17de70 2022-09-17T10:28:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.042+0000 7f91b27fc700 1 -- 172.21.15.62:0/3893014935 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f91ac01b030 con 0x7f91bc17de70 2022-09-17T10:28:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.042+0000 7f91b27fc700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f91a008ba40 0x7f91a008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.042+0000 7f91b27fc700 1 -- 172.21.15.62:0/3893014935 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f91ac0b0cf0 con 0x7f91bc17de70 2022-09-17T10:28:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.042+0000 7f91ba59c700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f91a008ba40 0x7f91a008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.043+0000 7f91ba59c700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f91a008ba40 0x7f91a008df00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f91b4003750 tx=0x7f91b4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.046+0000 7f91b27fc700 1 -- 172.21.15.62:0/3893014935 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f91ac0819b0 con 0x7f91bc17de70 2022-09-17T10:28:11.222 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.220+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f91bc06be90 con 0x7f91bc17de70 2022-09-17T10:28:11.223 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.220+0000 7f91b27fc700 1 -- 172.21.15.62:0/3893014935 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f91ac019020 con 0x7f91bc17de70 2022-09-17T10:28:11.223 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2022-09-17T10:28:11.224 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f91a008ba40 msgr2=0x7f91a008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.225 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f91a008ba40 0x7f91a008df00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f91b4003750 tx=0x7f91b4009040).stop 2022-09-17T10:28:11.225 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc17de70 msgr2=0x7f91bc179a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.225 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc17de70 0x7f91bc179a80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f91ac007f20 tx=0x7f91ac009860).stop 2022-09-17T10:28:11.226 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 shutdown_connections 2022-09-17T10:28:11.226 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f91a008ba40 0x7f91a008df00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.226 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91bc0e5440 0x7f91bc174580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.226 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91bc17de70 0x7f91bc179a80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.227 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 --2- 172.21.15.62:0/3893014935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91bc17da90 0x7f91bc179590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.227 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 >> 172.21.15.62:0/3893014935 conn(0x7f91bc05d9a0 msgr2=0x7f91bc0e4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:11.227 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 shutdown_connections 2022-09-17T10:28:11.227 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.222+0000 7f91bb59e700 1 -- 172.21.15.62:0/3893014935 wait complete. 2022-09-17T10:28:11.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-17T10:28:11.357 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.355+0000 7f70155f7700 1 Processor -- start 2022-09-17T10:28:11.358 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.355+0000 7f70155f7700 1 -- start start 2022-09-17T10:28:11.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.356+0000 7f70155f7700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f70101751b0 0x7f7010180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.356+0000 7f70155f7700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7010175590 0x7f7010180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.366 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.356+0000 7f70155f7700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70100c6dd0 con 0x7f7010181050 2022-09-17T10:28:11.367 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.356+0000 7f70155f7700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100f10e0 con 0x7f70101751b0 2022-09-17T10:28:11.367 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.356+0000 7f70155f7700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100f0660 con 0x7f7010175590 2022-09-17T10:28:11.367 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700e7fc700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7010175590 0x7f7010180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.367 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700e7fc700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7010175590 0x7f7010180b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.62:47442/0 (socket says 172.21.15.62:47442) 2022-09-17T10:28:11.368 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700e7fc700 1 -- 172.21.15.62:0/178623374 learned_addr learned my addr 172.21.15.62:0/178623374 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:11.368 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700effd700 1 --2- 172.21.15.62:0/178623374 >> v2:172.21.15.93:3300/0 conn(0x7f70101751b0 0x7f7010180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.368 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700e7fc700 1 -- 172.21.15.62:0/178623374 >> v2:172.21.15.93:3300/0 conn(0x7f70101751b0 msgr2=0x7f7010180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:11.368 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700e7fc700 1 --2- 172.21.15.62:0/178623374 >> v2:172.21.15.93:3300/0 conn(0x7f70101751b0 0x7f7010180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700e7fc700 1 -- 172.21.15.62:0/178623374 >> v1:172.21.15.93:6789/0 conn(0x7f7010181050 legacy=0x7f7010181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700e7fc700 1 -- 172.21.15.62:0/178623374 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70101801e0 con 0x7f7010175590 2022-09-17T10:28:11.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700e7fc700 1 --2- 172.21.15.62:0/178623374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7010175590 0x7f7010180b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7010085780 tx=0x7f70040090f0).ready entity=mon.2 client_cookie=c37086e513918628 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:11.369 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700dffb700 1 -- 172.21.15.62:0/178623374 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700400b520 con 0x7f7010175590 2022-09-17T10:28:11.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700dffb700 1 -- 172.21.15.62:0/178623374 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700400b680 con 0x7f7010175590 2022-09-17T10:28:11.370 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.357+0000 7f700dffb700 1 -- 172.21.15.62:0/178623374 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700400ba20 con 0x7f7010175590 2022-09-17T10:28:11.371 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.358+0000 7f70155f7700 1 -- 172.21.15.62:0/178623374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7010175590 msgr2=0x7f7010180b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.371 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.358+0000 7f70155f7700 1 --2- 172.21.15.62:0/178623374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7010175590 0x7f7010180b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7010085780 tx=0x7f70040090f0).stop 2022-09-17T10:28:11.372 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.358+0000 7f70155f7700 1 -- 172.21.15.62:0/178623374 shutdown_connections 2022-09-17T10:28:11.372 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.358+0000 7f70155f7700 1 --2- 172.21.15.62:0/178623374 >> v2:172.21.15.93:3300/0 conn(0x7f70101751b0 0x7f7010180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.373 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.358+0000 7f70155f7700 1 --2- 172.21.15.62:0/178623374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7010175590 0x7f7010180b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.373 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.358+0000 7f70155f7700 1 -- 172.21.15.62:0/178623374 >> 172.21.15.62:0/178623374 conn(0x7f701006a170 msgr2=0x7f70100f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:11.373 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.358+0000 7f70155f7700 1 -- 172.21.15.62:0/178623374 shutdown_connections 2022-09-17T10:28:11.374 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.358+0000 7f70155f7700 1 -- 172.21.15.62:0/178623374 wait complete. 2022-09-17T10:28:11.374 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.359+0000 7f70155f7700 1 Processor -- start 2022-09-17T10:28:11.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.360+0000 7f70155f7700 1 -- start start 2022-09-17T10:28:11.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.360+0000 7f70155f7700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70101751b0 0x7f701017d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.375 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.360+0000 7f70155f7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7010175590 0x7f701016dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f70155f7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7010181050 0x7f701016e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f70155f7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7010179bc0 con 0x7f7010181050 2022-09-17T10:28:11.376 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f70155f7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70100ec710 con 0x7f7010175590 2022-09-17T10:28:11.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f70155f7700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701017db90 con 0x7f70101751b0 2022-09-17T10:28:11.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7010181050 0x7f701016e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7010181050 0x7f701016e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50220/0 (socket says 172.21.15.62:50220) 2022-09-17T10:28:11.377 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 -- 172.21.15.62:0/2759102700 learned_addr learned my addr 172.21.15.62:0/2759102700 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:11.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700effd700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70101751b0 0x7f701017d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700e7fc700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7010175590 0x7f701016dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 -- 172.21.15.62:0/2759102700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70101751b0 msgr2=0x7f701017d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.378 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70101751b0 0x7f701017d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 -- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7010175590 msgr2=0x7f701016dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7010175590 0x7f701016dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 -- 172.21.15.62:0/2759102700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004009370 con 0x7f7010181050 2022-09-17T10:28:11.379 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f700f7fe700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7010181050 0x7f701016e200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f700800c7c0 tx=0x7f7008001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f6ff6ffd700 1 -- 172.21.15.62:0/2759102700 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800e4a0 con 0x7f7010181050 2022-09-17T10:28:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f6ff6ffd700 1 -- 172.21.15.62:0/2759102700 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700800e600 con 0x7f7010181050 2022-09-17T10:28:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701017de70 con 0x7f7010181050 2022-09-17T10:28:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f6ff6ffd700 1 -- 172.21.15.62:0/2759102700 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800e980 con 0x7f7010181050 2022-09-17T10:28:11.380 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.361+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70100ec0c0 con 0x7f7010181050 2022-09-17T10:28:11.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.362+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70100642a0 con 0x7f7010181050 2022-09-17T10:28:11.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.363+0000 7f6ff6ffd700 1 -- 172.21.15.62:0/2759102700 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f7008010070 con 0x7f7010181050 2022-09-17T10:28:11.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.364+0000 7f6ff6ffd700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6ff008ba40 0x7f6ff008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:11.381 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.364+0000 7f6ff6ffd700 1 -- 172.21.15.62:0/2759102700 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f70080affb0 con 0x7f7010181050 2022-09-17T10:28:11.382 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.364+0000 7f700effd700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6ff008ba40 0x7f6ff008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:11.383 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.364+0000 7f700effd700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6ff008ba40 0x7f6ff008df00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7000009c30 tx=0x7f7000009060).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:11.383 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.368+0000 7f6ff6ffd700 1 -- 172.21.15.62:0/2759102700 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f7008080bf0 con 0x7f7010181050 2022-09-17T10:28:11.580 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.578+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70100c4bd0 con 0x7f7010181050 2022-09-17T10:28:11.581 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.579+0000 7f6ff6ffd700 1 -- 172.21.15.62:0/2759102700 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+10539 (secure 0 0 0) 0x7f7008084210 con 0x7f7010181050 2022-09-17T10:28:11.582 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:11.583 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/2161434381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2161434381},{"type":"v1","addr":"172.21.15.62:6833","nonce":2161434381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/1194163827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1194163827},{"type":"v1","addr":"172.21.15.62:6839","nonce":1194163827}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/413826247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":413826247},{"type":"v1","addr":"172.21.15.93:6835","nonce":413826247}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4325,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3152394380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3152394380},{"type":"v1","addr":"172.21.15.159:6836","nonce":3152394380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2292269070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2292269070},{"type":"v1","addr":"172.21.15.62:6835","nonce":2292269070}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4327,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/301789402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":301789402},{"type":"v1","addr":"172.21.15.93:6837","nonce":301789402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4329,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1156565194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1156565194},{"type":"v1","addr":"172.21.15.62:6837","nonce":1156565194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4333,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6839/135709201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":135709201},{"type":"v1","addr":"172.21.15.93:6839","nonce":135709201}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4336,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6841/1241271614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6840","nonce":1241271614},{"type":"v1","addr":"172.21.15.93:6841","nonce":1241271614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/426632534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":426632534},{"type":"v1","addr":"172.21.15.159:6833","nonce":426632534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-09-17T10:27:42.793084+0000","modified":"2022-09-17T10:27:59.962997+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4360":{"gid":4360,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/574611303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":574611303},{"type":"v1","addr":"172.21.15.159:6839","nonce":574611303}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4365":{"gid":4365,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/802951039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":802951039},{"type":"v1","addr":"172.21.15.159:6837","nonce":802951039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-09-17T10:28:11.585 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6ff008ba40 msgr2=0x7f6ff008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6ff008ba40 0x7f6ff008df00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7000009c30 tx=0x7f7000009060).stop 2022-09-17T10:28:11.586 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7010181050 msgr2=0x7f701016e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:11.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7010181050 0x7f701016e200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f700800c7c0 tx=0x7f7008001510).stop 2022-09-17T10:28:11.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 shutdown_connections 2022-09-17T10:28:11.587 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f6ff008ba40 0x7f6ff008df00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7010181050 0x7f701016e200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70101751b0 0x7f701017d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 --2- 172.21.15.62:0/2759102700 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7010175590 0x7f701016dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:11.588 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 >> 172.21.15.62:0/2759102700 conn(0x7f701006a170 msgr2=0x7f7010181d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:11.589 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 shutdown_connections 2022-09-17T10:28:11.589 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:11.581+0000 7f70155f7700 1 -- 172.21.15.62:0/2759102700 wait complete. 2022-09-17T10:28:11.589 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 11 2022-09-17T10:28:12.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 50, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2022-09-17T10:27:42.793084+0000', 'modified': '2022-09-17T10:27:59.962997+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4360': {'gid': 4360, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.159:6839/574611303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 574611303}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 574611303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4365': {'gid': 4365, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6837/802951039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6835', 'nonce': 802951039}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 802951039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-09-17T10:28:12.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-09-17T10:28:12.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-09-17T10:28:12.940 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.937+0000 7fb729b9f700 1 Processor -- start 2022-09-17T10:28:12.940 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.937+0000 7fb729b9f700 1 -- start start 2022-09-17T10:28:12.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.938+0000 7fb729b9f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7241751b0 0x7fb724180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.966 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.938+0000 7fb729b9f700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb724175590 0x7fb724180b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.938+0000 7fb729b9f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb724181050 0x7fb724181dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.938+0000 7fb729b9f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7240f10e0 con 0x7fb7241751b0 2022-09-17T10:28:12.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.938+0000 7fb729b9f700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7240c6dd0 con 0x7fb724181050 2022-09-17T10:28:12.968 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.938+0000 7fb729b9f700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7241801e0 con 0x7fb724175590 2022-09-17T10:28:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7241751b0 0x7fb724180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7241751b0 0x7fb724180670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50230/0 (socket says 172.21.15.62:50230) 2022-09-17T10:28:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 -- 172.21.15.62:0/1146960182 learned_addr learned my addr 172.21.15.62:0/1146960182 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1146960182 >> v2:172.21.15.159:3300/0 conn(0x7fb724175590 0x7fb724180b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb723fff700 1 --2- 172.21.15.62:0/1146960182 >> v2:172.21.15.93:3300/0 conn(0x7fb724181050 0x7fb724181dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 -- 172.21.15.62:0/1146960182 >> v2:172.21.15.159:3300/0 conn(0x7fb724175590 msgr2=0x7fb724180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:12.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1146960182 >> v2:172.21.15.159:3300/0 conn(0x7fb724175590 0x7fb724180b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.971 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 -- 172.21.15.62:0/1146960182 >> v2:172.21.15.93:3300/0 conn(0x7fb724181050 msgr2=0x7fb724181dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1146960182 >> v2:172.21.15.93:3300/0 conn(0x7fb724181050 0x7fb724181dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 -- 172.21.15.62:0/1146960182 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7240f0840 con 0x7fb7241751b0 2022-09-17T10:28:12.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1146960182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb724180670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb724088650 tx=0x7fb7140090f0).ready entity=mon.0 client_cookie=5242b472e9a05d38 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:12.973 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7227fc700 1 -- 172.21.15.62:0/1146960182 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400f510 con 0x7fb7241751b0 2022-09-17T10:28:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7227fc700 1 -- 172.21.15.62:0/1146960182 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71400f670 con 0x7fb7241751b0 2022-09-17T10:28:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.939+0000 7fb7227fc700 1 -- 172.21.15.62:0/1146960182 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400fa10 con 0x7fb7241751b0 2022-09-17T10:28:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 -- 172.21.15.62:0/1146960182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 msgr2=0x7fb724180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:12.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1146960182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb724180670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb724088650 tx=0x7fb7140090f0).stop 2022-09-17T10:28:12.975 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 -- 172.21.15.62:0/1146960182 shutdown_connections 2022-09-17T10:28:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1146960182 >> v2:172.21.15.93:3300/0 conn(0x7fb724181050 0x7fb724181dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1146960182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb724180670 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1146960182 >> v2:172.21.15.159:3300/0 conn(0x7fb724175590 0x7fb724180b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 -- 172.21.15.62:0/1146960182 >> 172.21.15.62:0/1146960182 conn(0x7fb72406a170 msgr2=0x7fb7240f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:12.977 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 -- 172.21.15.62:0/1146960182 shutdown_connections 2022-09-17T10:28:12.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.940+0000 7fb729b9f700 1 -- 172.21.15.62:0/1146960182 wait complete. 2022-09-17T10:28:12.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.941+0000 7fb729b9f700 1 Processor -- start 2022-09-17T10:28:12.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.941+0000 7fb729b9f700 1 -- start start 2022-09-17T10:28:12.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.942+0000 7fb729b9f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb72418f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.942+0000 7fb729b9f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb724175590 0x7fb724178f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.942+0000 7fb729b9f700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb724181050 0x7fb7241680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.980 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.942+0000 7fb729b9f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240868b0 con 0x7fb7241751b0 2022-09-17T10:28:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.942+0000 7fb729b9f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240859c0 con 0x7fb724175590 2022-09-17T10:28:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.942+0000 7fb729b9f700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb724085ca0 con 0x7fb724181050 2022-09-17T10:28:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.942+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb72418f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb72418f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50244/0 (socket says 172.21.15.62:50244) 2022-09-17T10:28:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb7237fe700 1 -- 172.21.15.62:0/1968947306 learned_addr learned my addr 172.21.15.62:0/1968947306 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb724175590 0x7fb724178f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb723fff700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb724181050 0x7fb7241680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb7237fe700 1 -- 172.21.15.62:0/1968947306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb724181050 msgr2=0x7fb7241680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb724181050 0x7fb7241680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb7237fe700 1 -- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb724175590 msgr2=0x7fb724178f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb724175590 0x7fb724178f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb7237fe700 1 -- 172.21.15.62:0/1968947306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714009370 con 0x7fb7241751b0 2022-09-17T10:28:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb72418f3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb724088960 tx=0x7fb714016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:12.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb70b7fe700 1 -- 172.21.15.62:0/1968947306 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400fe50 con 0x7fb7241751b0 2022-09-17T10:28:12.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb70b7fe700 1 -- 172.21.15.62:0/1968947306 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb714011c60 con 0x7fb7241751b0 2022-09-17T10:28:12.986 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb729b9f700 1 -- 172.21.15.62:0/1968947306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb724085f80 con 0x7fb7241751b0 2022-09-17T10:28:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb70b7fe700 1 -- 172.21.15.62:0/1968947306 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71401b430 con 0x7fb7241751b0 2022-09-17T10:28:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.943+0000 7fb729b9f700 1 -- 172.21.15.62:0/1968947306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb724086540 con 0x7fb7241751b0 2022-09-17T10:28:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.945+0000 7fb70b7fe700 1 -- 172.21.15.62:0/1968947306 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fb714017040 con 0x7fb7241751b0 2022-09-17T10:28:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.946+0000 7fb70b7fe700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb70408ba10 0x7fb70408ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.946+0000 7fb70b7fe700 1 -- 172.21.15.62:0/1968947306 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb7140b2070 con 0x7fb7241751b0 2022-09-17T10:28:12.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.946+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb70408ba10 0x7fb70408ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.946+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb70408ba10 0x7fb70408ded0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb724064380 tx=0x7fb718008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:12.988 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.947+0000 7fb73b52bb80 1 Processor -- start 2022-09-17T10:28:12.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.947+0000 7fb73b52bb80 1 -- start start 2022-09-17T10:28:12.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.948+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c190 0x55987b1d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.948+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b21c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.989 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.948+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b1ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:12.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.948+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b110a50 con 0x55987b1ce340 2022-09-17T10:28:12.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.948+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b125900 con 0x55987b20c190 2022-09-17T10:28:12.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.948+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b0ed0d0 con 0x55987b20c570 2022-09-17T10:28:12.990 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb723fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b1ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c190 0x55987b1d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c190 0x55987b1d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.62:59930/0 (socket says 172.21.15.62:59930) 2022-09-17T10:28:12.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb722ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b21c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:12.991 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb7237fe700 1 -- 172.21.15.62:0/465936814 learned_addr learned my addr 172.21.15.62:0/465936814 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb723fff700 1 -- 172.21.15.62:0/465936814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 msgr2=0x55987b21c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb723fff700 1 --2- 172.21.15.62:0/465936814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b21c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb723fff700 1 -- 172.21.15.62:0/465936814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c190 msgr2=0x55987b1d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb723fff700 1 --2- 172.21.15.62:0/465936814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c190 0x55987b1d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb723fff700 1 -- 172.21.15.62:0/465936814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55987b1a5f70 con 0x55987b1ce340 2022-09-17T10:28:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb7237fe700 1 --2- 172.21.15.62:0/465936814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c190 0x55987b1d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:28:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb723fff700 1 --2- 172.21.15.62:0/465936814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b1ce7c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb71c0073f0 tx=0x7fb71c00b040).ready entity=mon.0 client_cookie=687e71dee8d3bae4 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb708ff9700 1 -- 172.21.15.62:0/465936814 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c00e070 con 0x55987b1ce340 2022-09-17T10:28:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb708ff9700 1 -- 172.21.15.62:0/465936814 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c007eb0 con 0x55987b1ce340 2022-09-17T10:28:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.949+0000 7fb708ff9700 1 -- 172.21.15.62:0/465936814 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c016660 con 0x55987b1ce340 2022-09-17T10:28:12.997 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 -- 172.21.15.62:0/465936814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 msgr2=0x55987b1ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/465936814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b1ce7c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb71c0073f0 tx=0x7fb71c00b040).stop 2022-09-17T10:28:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 -- 172.21.15.62:0/465936814 shutdown_connections 2022-09-17T10:28:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/465936814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c190 0x55987b1d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/465936814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b1ce7c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/465936814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b21c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 -- 172.21.15.62:0/465936814 >> 172.21.15.62:0/465936814 conn(0x55987b1d2dd0 msgr2=0x55987b1d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 -- 172.21.15.62:0/465936814 shutdown_connections 2022-09-17T10:28:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.950+0000 7fb73b52bb80 1 -- 172.21.15.62:0/465936814 wait complete. 2022-09-17T10:28:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.951+0000 7fb73b52bb80 1 -- start start 2022-09-17T10:28:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.951+0000 7fb73b52bb80 1 Processor -- start 2022-09-17T10:28:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b207200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c190 0x55987b1daa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c570 0x55987b2536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b254390 con 0x55987b1ce340 2022-09-17T10:28:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b211e60 con 0x55987b20c570 2022-09-17T10:28:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b212140 con 0x55987b20c190 2022-09-17T10:28:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb73b52bb80 10 client.0 ll_register_callbacks cb 0x55987b193360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-17T10:28:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b207200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b207200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50260/0 (socket says 172.21.15.62:50260) 2022-09-17T10:28:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 -- 172.21.15.62:0/1427108908 learned_addr learned my addr 172.21.15.62:0/1427108908 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c190 0x55987b1daa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb723fff700 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c570 0x55987b2536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 -- 172.21.15.62:0/1427108908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c190 msgr2=0x55987b1daa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c190 0x55987b1daa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 -- 172.21.15.62:0/1427108908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c570 msgr2=0x55987b2536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:13.006 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c570 0x55987b2536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.006 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 -- 172.21.15.62:0/1427108908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb724086540 con 0x55987b1ce340 2022-09-17T10:28:13.006 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b207200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fb714082e70 tx=0x7fb714006c20).ready entity=mon.0 client_cookie=e777717e079e07fc server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:13.006 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.952+0000 7fb6fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2022-09-17T10:28:13.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb6fdffb700 1 -- 172.21.15.62:0/1427108908 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714085e60 con 0x55987b1ce340 2022-09-17T10:28:13.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb6fdffb700 1 -- 172.21.15.62:0/1427108908 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb714085fc0 con 0x55987b1ce340 2022-09-17T10:28:13.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1427108908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55987b1cd710 con 0x55987b1ce340 2022-09-17T10:28:13.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb6fdffb700 1 -- 172.21.15.62:0/1427108908 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb71408bfd0 con 0x55987b1ce340 2022-09-17T10:28:13.007 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 10 client.4848 fetch_fsmap learned FSMap version 11 2022-09-17T10:28:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1427108908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x7fb71c009db0 con 0x55987b1ce340 2022-09-17T10:28:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb6fdffb700 1 -- 172.21.15.62:0/1427108908 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb714096080 con 0x55987b1ce340 2022-09-17T10:28:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb6fdffb700 1 -- 172.21.15.62:0/1427108908 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 11) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fb714082760 con 0x55987b1ce340 2022-09-17T10:28:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 10 client.4848 fetch_fsmap finished waiting for FSMap version 11 2022-09-17T10:28:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 10 client.4848 resolve_mds: resolved name 'f' to daemon mds.f 2022-09-17T10:28:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 20 client.4848 populate_metadata read hostname 'smithi062' 2022-09-17T10:28:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55987b206db0 0x55987b1fc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 4 client.4848 mds_command: new command op to 4365 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-17T10:28:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1427108908 --> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55987b11b7a0 con 0x55987b206db0 2022-09-17T10:28:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.953+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55987b206db0 0x55987b1fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.954+0000 7fb6fdffb700 10 client.4848 ms_handle_connect on v2:172.21.15.159:6835/802951039 2022-09-17T10:28:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.954+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55987b206db0 0x55987b1fc350 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4c87691d69efd020 server_cookie=a102bac870610828 in_seq=0 out_seq=0 2022-09-17T10:28:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.954+0000 7fb6fdffb700 1 -- 172.21.15.62:0/1427108908 <== mds.0 v2:172.21.15.159:6835/802951039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55987b11b7a0 con 0x55987b206db0 2022-09-17T10:28:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.954+0000 7fb6fdffb700 10 client.4848 handle_command_reply: tid=0 2022-09-17T10:28:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.954+0000 7fb73b52bb80 1 client.4848 shutdown 2022-09-17T10:28:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1427108908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 msgr2=0x55987b207200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b207200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fb714082e70 tx=0x7fb714006c20).stop 2022-09-17T10:28:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1427108908 shutdown_connections 2022-09-17T10:28:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b20c570 0x55987b2536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55987b206db0 0x55987b1fc350 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b1ce340 0x55987b207200 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1427108908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c190 0x55987b1daa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb6fdffb700 0 client.4848 ms_handle_reset on v2:172.21.15.159:6835/802951039 2022-09-17T10:28:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1427108908 >> 172.21.15.62:0/1427108908 conn(0x55987b1d2dd0 msgr2=0x55987b238fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1427108908 shutdown_connections 2022-09-17T10:28:13.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1427108908 wait complete. 2022-09-17T10:28:13.014 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.955+0000 7fb73b52bb80 20 client.4848 trim_cache size 0 max 16384 2022-09-17T10:28:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.972+0000 7fb73b52bb80 1 Processor -- start 2022-09-17T10:28:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.972+0000 7fb73b52bb80 1 -- start start 2022-09-17T10:28:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 0x55987b1d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b1fb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b1fb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b241ea0 con 0x55987b20c190 2022-09-17T10:28:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b1fb9f0 con 0x55987b1ce340 2022-09-17T10:28:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b210270 con 0x55987b20c570 2022-09-17T10:28:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b1fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b1fb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50264/0 (socket says 172.21.15.62:50264) 2022-09-17T10:28:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 -- 172.21.15.62:0/1509917441 learned_addr learned my addr 172.21.15.62:0/1509917441 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb7237fe700 1 --2- 172.21.15.62:0/1509917441 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 0x55987b1d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 -- 172.21.15.62:0/1509917441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 msgr2=0x55987b1fb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1509917441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b1fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 -- 172.21.15.62:0/1509917441 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 msgr2=0x55987b1d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1509917441 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 0x55987b1d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 -- 172.21.15.62:0/1509917441 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55987af57990 con 0x55987b20c190 2022-09-17T10:28:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb722ffd700 1 --2- 172.21.15.62:0/1509917441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b1fb010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fb724178e50 tx=0x7fb718016000).ready entity=mon.0 client_cookie=52cdabbfae57ff63 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb7097fa700 1 -- 172.21.15.62:0/1509917441 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718028070 con 0x55987b20c190 2022-09-17T10:28:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb7097fa700 1 -- 172.21.15.62:0/1509917441 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718015cf0 con 0x55987b20c190 2022-09-17T10:28:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.973+0000 7fb7097fa700 1 -- 172.21.15.62:0/1509917441 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718015e60 con 0x55987b20c190 2022-09-17T10:28:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1509917441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 msgr2=0x55987b1fb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1509917441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b1fb010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fb724178e50 tx=0x7fb718016000).stop 2022-09-17T10:28:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1509917441 shutdown_connections 2022-09-17T10:28:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1509917441 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 0x55987b1d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1509917441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b1fb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/1509917441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b1fb010 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1509917441 >> 172.21.15.62:0/1509917441 conn(0x55987b1d2dd0 msgr2=0x55987b205f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1509917441 shutdown_connections 2022-09-17T10:28:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.974+0000 7fb73b52bb80 1 -- 172.21.15.62:0/1509917441 wait complete. 2022-09-17T10:28:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.975+0000 7fb73b52bb80 1 -- start start 2022-09-17T10:28:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.975+0000 7fb73b52bb80 1 Processor -- start 2022-09-17T10:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 0x55987b1d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b21a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb73b52bb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b1c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b238200 con 0x55987b20c190 2022-09-17T10:28:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b20b470 con 0x55987b1ce340 2022-09-17T10:28:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb73b52bb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55987b2a81c0 con 0x55987b20c570 2022-09-17T10:28:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb73b52bb80 10 client.0 ll_register_callbacks cb 0x55987b193360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-17T10:28:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b21a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b21a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50274/0 (socket says 172.21.15.62:50274) 2022-09-17T10:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 -- 172.21.15.62:0/2112038210 learned_addr learned my addr 172.21.15.62:0/2112038210 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb7237fe700 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 0x55987b1d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb723fff700 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b1c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.031 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 -- 172.21.15.62:0/2112038210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 msgr2=0x55987b1c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b1c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 -- 172.21.15.62:0/2112038210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 msgr2=0x55987b1d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 0x55987b1d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 -- 172.21.15.62:0/2112038210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb718011d10 con 0x55987b20c190 2022-09-17T10:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb722ffd700 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b21a980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb718000c00 tx=0x7fb718018000).ready entity=mon.0 client_cookie=179b62e956886ddd server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb6fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2022-09-17T10:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb6fdffb700 1 -- 172.21.15.62:0/2112038210 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71802dac0 con 0x55987b20c190 2022-09-17T10:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb6fdffb700 1 -- 172.21.15.62:0/2112038210 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb71802dc20 con 0x55987b20c190 2022-09-17T10:28:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.976+0000 7fb73b52bb80 1 -- 172.21.15.62:0/2112038210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb71c007eb0 con 0x55987b20c190 2022-09-17T10:28:13.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb6fdffb700 1 -- 172.21.15.62:0/2112038210 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb718035480 con 0x55987b20c190 2022-09-17T10:28:13.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb73b52bb80 10 client.4854 fetch_fsmap learned FSMap version 11 2022-09-17T10:28:13.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb73b52bb80 1 -- 172.21.15.62:0/2112038210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x55987afc6c80 con 0x55987b20c190 2022-09-17T10:28:13.034 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb6fdffb700 1 -- 172.21.15.62:0/2112038210 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c007eb0 con 0x55987b20c190 2022-09-17T10:28:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb6fdffb700 1 -- 172.21.15.62:0/2112038210 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 11) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fb7180355e0 con 0x55987b20c190 2022-09-17T10:28:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb73b52bb80 10 client.4854 fetch_fsmap finished waiting for FSMap version 11 2022-09-17T10:28:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb73b52bb80 10 client.4854 resolve_mds: resolved name 'f' to daemon mds.f 2022-09-17T10:28:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb73b52bb80 20 client.4854 populate_metadata read hostname 'smithi062' 2022-09-17T10:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55987b20ef50 0x55987b20f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb73b52bb80 4 client.4854 mds_command: new command op to 4365 tid=0[{"prefix": "status"}] 2022-09-17T10:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb73b52bb80 1 -- 172.21.15.62:0/2112038210 --> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55987b112640 con 0x55987b20ef50 2022-09-17T10:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.977+0000 7fb7237fe700 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55987b20ef50 0x55987b20f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb6fdffb700 10 client.4854 ms_handle_connect on v2:172.21.15.159:6835/802951039 2022-09-17T10:28:13.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb7237fe700 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55987b20ef50 0x55987b20f330 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=49be2fc9236efd57 server_cookie=d24e7e52f5586534 in_seq=0 out_seq=0 2022-09-17T10:28:13.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb6fdffb700 1 -- 172.21.15.62:0/2112038210 <== mds.0 v2:172.21.15.159:6835/802951039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55987b112640 con 0x55987b20ef50 2022-09-17T10:28:13.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb6fdffb700 10 client.4854 handle_command_reply: tid=0 2022-09-17T10:28:13.037 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 client.4854 shutdown 2022-09-17T10:28:13.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 -- 172.21.15.62:0/2112038210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 msgr2=0x55987b21a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:13.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b21a980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb718000c00 tx=0x7fb718018000).stop 2022-09-17T10:28:13.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 -- 172.21.15.62:0/2112038210 shutdown_connections 2022-09-17T10:28:13.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55987b1ce340 0x55987b1d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.038 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55987b20ef50 0x55987b20f330 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55987b20c570 0x55987b1c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb6fdffb700 0 client.4854 ms_handle_reset on v2:172.21.15.159:6835/802951039 2022-09-17T10:28:13.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 --2- 172.21.15.62:0/2112038210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55987b20c190 0x55987b21a980 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.039 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 -- 172.21.15.62:0/2112038210 >> 172.21.15.62:0/2112038210 conn(0x55987b1d2dd0 msgr2=0x55987b208150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:13.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 -- 172.21.15.62:0/2112038210 shutdown_connections 2022-09-17T10:28:13.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 1 -- 172.21.15.62:0/2112038210 wait complete. 2022-09-17T10:28:13.040 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.978+0000 7fb73b52bb80 20 client.4854 trim_cache size 0 max 16384 2022-09-17T10:28:13.041 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2022-09-17T10:28:13.041 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "caff66e9-e5bf-4b11-8278-68b3c904b131", 2022-09-17T10:28:13.041 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2022-09-17T10:28:13.041 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4365, 2022-09-17T10:28:13.042 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2022-09-17T10:28:13.042 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2022-09-17T10:28:13.042 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2022-09-17T10:28:13.042 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 30.183647623999999, 2022-09-17T10:28:13.043 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 11, 2022-09-17T10:28:13.043 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 31, 2022-09-17T10:28:13.043 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 31, 2022-09-17T10:28:13.043 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 35.423853647000001 2022-09-17T10:28:13.044 INFO:teuthology.orchestra.run.smithi062.stdout:} 2022-09-17T10:28:13.045 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 -- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb70408ba10 msgr2=0x7fb70408ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:13.046 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb70408ba10 0x7fb70408ded0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb724064380 tx=0x7fb718008040).stop 2022-09-17T10:28:13.046 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 -- 172.21.15.62:0/1968947306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 msgr2=0x7fb72418f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:13.046 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb72418f3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb724088960 tx=0x7fb714016000).stop 2022-09-17T10:28:13.046 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 -- 172.21.15.62:0/1968947306 shutdown_connections 2022-09-17T10:28:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fb70408ba10 0x7fb70408ded0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb724181050 0x7fb7241680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7241751b0 0x7fb72418f3c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 --2- 172.21.15.62:0/1968947306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb724175590 0x7fb724178f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:13.048 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 -- 172.21.15.62:0/1968947306 >> 172.21.15.62:0/1968947306 conn(0x7fb72406a170 msgr2=0x7fb7240ef580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:13.048 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 -- 172.21.15.62:0/1968947306 shutdown_connections 2022-09-17T10:28:13.048 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:12.979+0000 7fb729b9f700 1 -- 172.21.15.62:0/1968947306 wait complete. 2022-09-17T10:28:13.049 INFO:teuthology.run_tasks:Running task kclient... 2022-09-17T10:28:13.063 INFO:tasks.kclient:Mounting kernel clients... 2022-09-17T10:28:13.064 INFO:tasks.kclient:config is {'client.0': {}} 2022-09-17T10:28:13.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.065 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2022-09-17T10:28:13.081 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2022-09-17T10:28:13.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-09-17T10:28:13.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2022-09-17T10:28:13.260 INFO:tasks.kclient:client.0 config is {'mntopts': ['nowsync']} 2022-09-17T10:28:13.261 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-09-17T10:28:13.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2022-09-17T10:28:13.263 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-09-17T10:28:13.263 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-09-17T10:28:13.264 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-09-17T10:28:13.264 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-09-17T10:28:13.265 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-09-17T10:28:13.266 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-09-17T10:28:13.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.268 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2022-09-17T10:28:13.285 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-09-17T10:28:13.285 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-09-17T10:28:13.287 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2022-09-17T10:28:13.287 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2022-09-17T10:28:13.288 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2022-09-17T10:28:13.288 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2022-09-17T10:28:13.289 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-17T10:28:13.289 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2022-09-17T10:28:13.289 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-17T10:28:13.290 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2022-09-17T10:28:13.290 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-09-17T10:28:13.292 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2022-09-17T10:28:13.292 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-09-17T10:28:13.292 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2022-09-17T10:28:13.293 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-09-17T10:28:13.293 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42484sec preferred_lft 42484sec 2022-09-17T10:28:13.293 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2022-09-17T10:28:13.294 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2022-09-17T10:28:13.294 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-09-17T10:28:13.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.295 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:28:13.296 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:28:13.296 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2022-09-17T10:28:13.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2022-09-17T10:28:13.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2022-09-17T10:28:13.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-09-17T10:28:13.298 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:28:13.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.400 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-09-17T10:28:13.425 INFO:teuthology.orchestra.run.smithi062.stdout:1 2022-09-17T10:28:13.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.427 DEBUG:teuthology.orchestra.run.smithi062:> route 2022-09-17T10:28:13.485 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2022-09-17T10:28:13.486 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-09-17T10:28:13.486 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-09-17T10:28:13.487 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-09-17T10:28:13.488 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-09-17T10:28:13.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.489 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:28:13.490 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:28:13.490 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-09-17T10:28:13.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-09-17T10:28:13.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-09-17T10:28:13.491 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:28:13.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.589 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2022-09-17T10:28:13.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.605 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2022-09-17T10:28:13.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.661 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:28:13.662 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:28:13.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-09-17T10:28:13.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-09-17T10:28:13.664 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:28:13.751 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-09-17T10:28:13.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.752 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:28:13.752 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:28:13.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-09-17T10:28:13.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-09-17T10:28:13.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-09-17T10:28:13.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-09-17T10:28:13.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-09-17T10:28:13.755 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:28:13.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:13.936 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2022-09-17T10:28:13.937 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2022-09-17T10:28:13.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2022-09-17T10:28:13.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2022-09-17T10:28:13.938 DEBUG:teuthology.orchestra.run.smithi062:> ') 2022-09-17T10:28:14.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-17T10:28:14.151 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.149+0000 7f450fccc700 1 Processor -- start 2022-09-17T10:28:14.151 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.149+0000 7f450fccc700 1 -- start start 2022-09-17T10:28:14.154 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450fccc700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4508178420 0x7f450817e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.154 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450fccc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4508178800 0x7f450817c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.154 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450fccc700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450817dd00 con 0x7f45080ec680 2022-09-17T10:28:14.155 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450fccc700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450817e680 con 0x7f4508178800 2022-09-17T10:28:14.155 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450fccc700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080e8ce0 con 0x7f4508178420 2022-09-17T10:28:14.155 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450da68700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4508178420 0x7f450817e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450d267700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f45080ec680 0x7f45080e85d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.62:38204/0 (socket says 172.21.15.62:38204) 2022-09-17T10:28:14.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450d267700 1 -- 172.21.15.62:0/2488249030 learned_addr learned my addr 172.21.15.62:0/2488249030 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:14.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450da68700 1 --2- 172.21.15.62:0/2488249030 >> v2:172.21.15.159:3300/0 conn(0x7f4508178420 0x7f450817e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.62:36326/0 (socket says 172.21.15.62:36326) 2022-09-17T10:28:14.156 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.150+0000 7f450e269700 1 --2- 172.21.15.62:0/2488249030 >> v2:172.21.15.93:3300/0 conn(0x7f4508178800 0x7f450817c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450da68700 1 -- 172.21.15.62:0/2488249030 >> v2:172.21.15.93:3300/0 conn(0x7f4508178800 msgr2=0x7f450817c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:14.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450da68700 1 --2- 172.21.15.62:0/2488249030 >> v2:172.21.15.93:3300/0 conn(0x7f4508178800 0x7f450817c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450da68700 1 -- 172.21.15.62:0/2488249030 >> v1:172.21.15.159:6789/0 conn(0x7f45080ec680 legacy=0x7f45080e85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.157 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450ca66700 1 -- 172.21.15.62:0/2488249030 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380921792 0 0) 0x7f450817dd00 con 0x7f45080ec680 2022-09-17T10:28:14.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450da68700 1 -- 172.21.15.62:0/2488249030 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080ecb00 con 0x7f4508178420 2022-09-17T10:28:14.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450da68700 1 --2- 172.21.15.62:0/2488249030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178420 0x7f450817e190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f45080eb790 tx=0x7f44f8009060).ready entity=mon.2 client_cookie=75e095f07fa72a2d server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450ca66700 1 -- 172.21.15.62:0/2488249030 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800f510 con 0x7f4508178420 2022-09-17T10:28:14.158 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450ca66700 1 -- 172.21.15.62:0/2488249030 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800f670 con 0x7f4508178420 2022-09-17T10:28:14.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450ca66700 1 -- 172.21.15.62:0/2488249030 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800f9f0 con 0x7f4508178420 2022-09-17T10:28:14.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450fccc700 1 -- 172.21.15.62:0/2488249030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178420 msgr2=0x7f450817e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450fccc700 1 --2- 172.21.15.62:0/2488249030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178420 0x7f450817e190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f45080eb790 tx=0x7f44f8009060).stop 2022-09-17T10:28:14.159 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450fccc700 1 -- 172.21.15.62:0/2488249030 shutdown_connections 2022-09-17T10:28:14.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450fccc700 1 --2- 172.21.15.62:0/2488249030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178420 0x7f450817e190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450fccc700 1 --2- 172.21.15.62:0/2488249030 >> v2:172.21.15.93:3300/0 conn(0x7f4508178800 0x7f450817c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.151+0000 7f450fccc700 1 -- 172.21.15.62:0/2488249030 >> 172.21.15.62:0/2488249030 conn(0x7f45080edc30 msgr2=0x7f45080ee040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:14.160 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.152+0000 7f450fccc700 1 -- 172.21.15.62:0/2488249030 shutdown_connections 2022-09-17T10:28:14.161 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.152+0000 7f450fccc700 1 -- 172.21.15.62:0/2488249030 wait complete. 2022-09-17T10:28:14.164 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.153+0000 7f450fccc700 1 Processor -- start 2022-09-17T10:28:14.164 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.153+0000 7f450fccc700 1 -- start start 2022-09-17T10:28:14.165 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450fccc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45080ec680 0x7f4508175cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.165 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450fccc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4508178420 0x7f45081761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.165 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450fccc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178800 0x7f4508190c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.166 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450fccc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508190790 con 0x7f45080ec680 2022-09-17T10:28:14.166 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450fccc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508068c70 con 0x7f4508178420 2022-09-17T10:28:14.166 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450fccc700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450818fb80 con 0x7f4508178800 2022-09-17T10:28:14.166 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450da68700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45080ec680 0x7f4508175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450da68700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45080ec680 0x7f4508175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39526/0 (socket says 172.21.15.62:39526) 2022-09-17T10:28:14.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450da68700 1 -- 172.21.15.62:0/3084118074 learned_addr learned my addr 172.21.15.62:0/3084118074 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:14.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450d267700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4508178420 0x7f45081761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.167 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450e269700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178800 0x7f4508190c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.154+0000 7f450da68700 1 -- 172.21.15.62:0/3084118074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178800 msgr2=0x7f4508190c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f450da68700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178800 0x7f4508190c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f450da68700 1 -- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4508178420 msgr2=0x7f45081761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.168 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f450da68700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4508178420 0x7f45081761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f450da68700 1 -- 172.21.15.62:0/3084118074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80092a0 con 0x7f45080ec680 2022-09-17T10:28:14.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f450da68700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45080ec680 0x7f4508175cb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f44f8006d70 tx=0x7f44f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f4505ffb700 1 -- 172.21.15.62:0/3084118074 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800f7e0 con 0x7f45080ec680 2022-09-17T10:28:14.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f4505ffb700 1 -- 172.21.15.62:0/3084118074 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800f940 con 0x7f45080ec680 2022-09-17T10:28:14.169 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f4505ffb700 1 -- 172.21.15.62:0/3084118074 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f801b660 con 0x7f45080ec680 2022-09-17T10:28:14.170 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450818fe60 con 0x7f45080ec680 2022-09-17T10:28:14.170 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.155+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4508190420 con 0x7f45080ec680 2022-09-17T10:28:14.170 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.156+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450806bf40 con 0x7f45080ec680 2022-09-17T10:28:14.170 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.157+0000 7f4505ffb700 1 -- 172.21.15.62:0/3084118074 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f44f802b070 con 0x7f45080ec680 2022-09-17T10:28:14.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.157+0000 7f4505ffb700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f44e808ba70 0x7f44e808df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.157+0000 7f4505ffb700 1 -- 172.21.15.62:0/3084118074 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f44f80b20e0 con 0x7f45080ec680 2022-09-17T10:28:14.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.158+0000 7f450d267700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f44e808ba70 0x7f44e808df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.171 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.158+0000 7f450d267700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f44e808ba70 0x7f44e808df30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f45080efe80 tx=0x7f44fc007dd0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.172 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.161+0000 7f4505ffb700 1 -- 172.21.15.62:0/3084118074 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f44f8082da0 con 0x7f45080ec680 2022-09-17T10:28:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.336+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4508066770 con 0x7f45080ec680 2022-09-17T10:28:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.337+0000 7f4505ffb700 1 -- 172.21.15.62:0/3084118074 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23461 (secure 0 0 0) 0x7f44f8029090 con 0x7f45080ec680 2022-09-17T10:28:14.340 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:14.340 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"fsid":"caff66e9-e5bf-4b11-8278-68b3c904b131","created":"2022-09-17T10:27:22.306193+0000","modified":"2022-09-17T10:27:47.199891+0000","last_up_change":"2022-09-17T10:27:32.339830+0000","last_in_change":"2022-09-17T10:27:25.907826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-09-17T10:27:32.392964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-17T10:27:35.474566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-09-17T10:27:40.468667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-09-17T10:27:41.769803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-09-17T10:27:44.846733+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3a2cd6a0-794c-4556-a111-e8ccfef84dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":81782},{"type":"v1","addr":"172.21.15.62:6801","nonce":81782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":81782},{"type":"v1","addr":"172.21.15.62:6803","nonce":81782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":81782},{"type":"v1","addr":"172.21.15.62:6807","nonce":81782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":81782},{"type":"v1","addr":"172.21.15.62:6805","nonce":81782}]},"public_addr":"172.21.15.62:6801/81782","cluster_addr":"172.21.15.62:6803/81782","heartbeat_back_addr":"172.21.15.62:6807/81782","heartbeat_front_addr":"172.21.15.62:6805/81782","state":["exists","up"]},{"osd":1,"uuid":"5f3b4267-d29c-46af-ae7f-766c76955a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":81655},{"type":"v1","addr":"172.21.15.93:6825","nonce":81655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":81655},{"type":"v1","addr":"172.21.15.93:6827","nonce":81655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":81655},{"type":"v1","addr":"172.21.15.93:6831","nonce":81655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":81655},{"type":"v1","addr":"172.21.15.93:6829","nonce":81655}]},"public_addr":"172.21.15.93:6825/81655","cluster_addr":"172.21.15.93:6827/81655","heartbeat_back_addr":"172.21.15.93:6831/81655","heartbeat_front_addr":"172.21.15.93:6829/81655","state":["exists","up"]},{"osd":2,"uuid":"1ee5fe22-6b92-4c34-8dd6-81c56f857f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6801","nonce":81895},{"type":"v1","addr":"172.21.15.159:6803","nonce":81895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6805","nonce":81895},{"type":"v1","addr":"172.21.15.159:6807","nonce":81895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":81895},{"type":"v1","addr":"172.21.15.159:6815","nonce":81895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6809","nonce":81895},{"type":"v1","addr":"172.21.15.159:6811","nonce":81895}]},"public_addr":"172.21.15.159:6803/81895","cluster_addr":"172.21.15.159:6807/81895","heartbeat_back_addr":"172.21.15.159:6815/81895","heartbeat_front_addr":"172.21.15.159:6811/81895","state":["exists","up"]},{"osd":3,"uuid":"9278d65c-b17e-4045-adfc-d2e96019b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":81783},{"type":"v1","addr":"172.21.15.62:6813","nonce":81783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":81783},{"type":"v1","addr":"172.21.15.62:6818","nonce":81783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":81783},{"type":"v1","addr":"172.21.15.62:6823","nonce":81783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":81783},{"type":"v1","addr":"172.21.15.62:6821","nonce":81783}]},"public_addr":"172.21.15.62:6813/81783","cluster_addr":"172.21.15.62:6818/81783","heartbeat_back_addr":"172.21.15.62:6823/81783","heartbeat_front_addr":"172.21.15.62:6821/81783","state":["exists","up"]},{"osd":4,"uuid":"fbed8313-d12f-4e79-8f22-d387097835b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":81642},{"type":"v1","addr":"172.21.15.93:6801","nonce":81642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":81642},{"type":"v1","addr":"172.21.15.93:6803","nonce":81642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":81642},{"type":"v1","addr":"172.21.15.93:6807","nonce":81642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":81642},{"type":"v1","addr":"172.21.15.93:6805","nonce":81642}]},"public_addr":"172.21.15.93:6801/81642","cluster_addr":"172.21.15.93:6803/81642","heartbeat_back_addr":"172.21.15.93:6807/81642","heartbeat_front_addr":"172.21.15.93:6805/81642","state":["exists","up"]},{"osd":5,"uuid":"b9e1942a-3fde-4686-9d3d-0d6eb7bffe90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":81896},{"type":"v1","addr":"172.21.15.159:6802","nonce":81896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":81896},{"type":"v1","addr":"172.21.15.159:6806","nonce":81896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":81896},{"type":"v1","addr":"172.21.15.159:6814","nonce":81896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":81896},{"type":"v1","addr":"172.21.15.159:6810","nonce":81896}]},"public_addr":"172.21.15.159:6802/81896","cluster_addr":"172.21.15.159:6806/81896","heartbeat_back_addr":"172.21.15.159:6814/81896","heartbeat_front_addr":"172.21.15.159:6810/81896","state":["exists","up"]},{"osd":6,"uuid":"44fdf3ae-54fc-4276-978d-cd8cdbf551f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":81817},{"type":"v1","addr":"172.21.15.62:6825","nonce":81817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":81817},{"type":"v1","addr":"172.21.15.62:6827","nonce":81817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":81817},{"type":"v1","addr":"172.21.15.62:6831","nonce":81817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":81817},{"type":"v1","addr":"172.21.15.62:6829","nonce":81817}]},"public_addr":"172.21.15.62:6825/81817","cluster_addr":"172.21.15.62:6827/81817","heartbeat_back_addr":"172.21.15.62:6831/81817","heartbeat_front_addr":"172.21.15.62:6829/81817","state":["exists","up"]},{"osd":7,"uuid":"a33d0b4b-7855-4df5-a940-ef1ed14dc089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":81643},{"type":"v1","addr":"172.21.15.93:6809","nonce":81643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":81643},{"type":"v1","addr":"172.21.15.93:6811","nonce":81643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":81643},{"type":"v1","addr":"172.21.15.93:6815","nonce":81643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":81643},{"type":"v1","addr":"172.21.15.93:6813","nonce":81643}]},"public_addr":"172.21.15.93:6809/81643","cluster_addr":"172.21.15.93:6811/81643","heartbeat_back_addr":"172.21.15.93:6815/81643","heartbeat_front_addr":"172.21.15.93:6813/81643","state":["exists","up"]},{"osd":8,"uuid":"1fb7510e-c67f-4523-8906-7fbe25054044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":81940},{"type":"v1","addr":"172.21.15.159:6825","nonce":81940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":81940},{"type":"v1","addr":"172.21.15.159:6827","nonce":81940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":81940},{"type":"v1","addr":"172.21.15.159:6831","nonce":81940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":81940},{"type":"v1","addr":"172.21.15.159:6829","nonce":81940}]},"public_addr":"172.21.15.159:6825/81940","cluster_addr":"172.21.15.159:6827/81940","heartbeat_back_addr":"172.21.15.159:6831/81940","heartbeat_front_addr":"172.21.15.159:6829/81940","state":["exists","up"]},{"osd":9,"uuid":"387d2fbb-304c-4360-b0c2-9dbf6df590e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":81794},{"type":"v1","addr":"172.21.15.62:6809","nonce":81794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":81794},{"type":"v1","addr":"172.21.15.62:6812","nonce":81794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":81794},{"type":"v1","addr":"172.21.15.62:6819","nonce":81794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":81794},{"type":"v1","addr":"172.21.15.62:6816","nonce":81794}]},"public_addr":"172.21.15.62:6809/81794","cluster_addr":"172.21.15.62:6812/81794","heartbeat_back_addr":"172.21.15.62:6819/81794","heartbeat_front_addr":"172.21.15.62:6816/81794","state":["exists","up"]},{"osd":10,"uuid":"c2e80d24-b7e8-4141-b276-c2140a4ccdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":81644},{"type":"v1","addr":"172.21.15.93:6817","nonce":81644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":81644},{"type":"v1","addr":"172.21.15.93:6819","nonce":81644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":81644},{"type":"v1","addr":"172.21.15.93:6823","nonce":81644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":81644},{"type":"v1","addr":"172.21.15.93:6821","nonce":81644}]},"public_addr":"172.21.15.93:6817/81644","cluster_addr":"172.21.15.93:6819/81644","heartbeat_back_addr":"172.21.15.93:6823/81644","heartbeat_front_addr":"172.21.15.93:6821/81644","state":["exists","up"]},{"osd":11,"uuid":"e881702a-da6a-4d37-873b-4d8edd7eecbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":81905},{"type":"v1","addr":"172.21.15.159:6817","nonce":81905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":81905},{"type":"v1","addr":"172.21.15.159:6819","nonce":81905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":81905},{"type":"v1","addr":"172.21.15.159:6823","nonce":81905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":81905},{"type":"v1","addr":"172.21.15.159:6821","nonce":81905}]},"public_addr":"172.21.15.159:6817/81905","cluster_addr":"172.21.15.159:6819/81905","heartbeat_back_addr":"172.21.15.159:6823/81905","heartbeat_front_addr":"172.21.15.159:6821/81905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.759340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.075719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.081631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.079297+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.105516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:30.998503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.046457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.062630+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.120278+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.023174+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.100525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2022-09-17T10:27:31.068239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-17T10:28:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f44e808ba70 msgr2=0x7f44e808df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f44e808ba70 0x7f44e808df30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f45080efe80 tx=0x7f44fc007dd0).stop 2022-09-17T10:28:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45080ec680 msgr2=0x7f4508175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45080ec680 0x7f4508175cb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f44f8006d70 tx=0x7f44f8017000).stop 2022-09-17T10:28:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 shutdown_connections 2022-09-17T10:28:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f44e808ba70 0x7f44e808df30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4508178800 0x7f4508190c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45080ec680 0x7f4508175cb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 --2- 172.21.15.62:0/3084118074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4508178420 0x7f45081761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 >> 172.21.15.62:0/3084118074 conn(0x7f45080edc30 msgr2=0x7f45080ee7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.339+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 shutdown_connections 2022-09-17T10:28:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.340+0000 7f450fccc700 1 -- 172.21.15.62:0/3084118074 wait complete. 2022-09-17T10:28:14.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-09-17T10:27:32.392964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-09-17T10:27:35.474566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-09-17T10:27:40.468667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-09-17T10:27:41.769803+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-09-17T10:27:44.846733+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-09-17T10:28:14.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-09-17T10:28:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.474+0000 7f310693e700 1 Processor -- start 2022-09-17T10:28:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.474+0000 7f310693e700 1 -- start start 2022-09-17T10:28:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f310693e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3100174ff0 0x7f3100063d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f310693e700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f310017d490 0x7f310017d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f310693e700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3100175470 con 0x7f3100174c10 2022-09-17T10:28:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f310693e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31000641f0 con 0x7f3100174ff0 2022-09-17T10:28:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f310693e700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310017c110 con 0x7f310017d490 2022-09-17T10:28:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f30ff7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3100174ff0 0x7f3100063d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f30ff7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3100174ff0 0x7f3100063d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39536/0 (socket says 172.21.15.62:39536) 2022-09-17T10:28:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f30ff7fe700 1 -- 172.21.15.62:0/654975637 learned_addr learned my addr 172.21.15.62:0/654975637 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.475+0000 7f3104edb700 1 --2- 172.21.15.62:0/654975637 >> v2:172.21.15.159:3300/0 conn(0x7f310017d490 0x7f310017d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30ff7fe700 1 -- 172.21.15.62:0/654975637 >> v2:172.21.15.159:3300/0 conn(0x7f310017d490 msgr2=0x7f310017d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30ff7fe700 1 --2- 172.21.15.62:0/654975637 >> v2:172.21.15.159:3300/0 conn(0x7f310017d490 0x7f310017d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30ff7fe700 1 -- 172.21.15.62:0/654975637 >> v1:172.21.15.159:6789/0 conn(0x7f3100174c10 legacy=0x7f31000635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30feffd700 1 -- 172.21.15.62:0/654975637 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583116315 0 0) 0x7f3100175470 con 0x7f3100174c10 2022-09-17T10:28:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30ff7fe700 1 -- 172.21.15.62:0/654975637 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310017c3f0 con 0x7f3100174ff0 2022-09-17T10:28:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30ff7fe700 1 --2- 172.21.15.62:0/654975637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f3100063d00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3100150c00 tx=0x7f30f00090f0).ready entity=mon.0 client_cookie=70a40e3802b47ff9 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30feffd700 1 -- 172.21.15.62:0/654975637 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000b520 con 0x7f3100174ff0 2022-09-17T10:28:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30feffd700 1 -- 172.21.15.62:0/654975637 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000b680 con 0x7f3100174ff0 2022-09-17T10:28:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f30feffd700 1 -- 172.21.15.62:0/654975637 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000ba00 con 0x7f3100174ff0 2022-09-17T10:28:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f310693e700 1 -- 172.21.15.62:0/654975637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 msgr2=0x7f3100063d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f310693e700 1 --2- 172.21.15.62:0/654975637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f3100063d00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3100150c00 tx=0x7f30f00090f0).stop 2022-09-17T10:28:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f310693e700 1 -- 172.21.15.62:0/654975637 shutdown_connections 2022-09-17T10:28:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f310693e700 1 --2- 172.21.15.62:0/654975637 >> v2:172.21.15.159:3300/0 conn(0x7f310017d490 0x7f310017d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f310693e700 1 --2- 172.21.15.62:0/654975637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f3100063d00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f310693e700 1 -- 172.21.15.62:0/654975637 >> 172.21.15.62:0/654975637 conn(0x7f31000f4c90 msgr2=0x7f31000f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f310693e700 1 -- 172.21.15.62:0/654975637 shutdown_connections 2022-09-17T10:28:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.476+0000 7f310693e700 1 -- 172.21.15.62:0/654975637 wait complete. 2022-09-17T10:28:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.478+0000 7f310693e700 1 Processor -- start 2022-09-17T10:28:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.478+0000 7f310693e700 1 -- start start 2022-09-17T10:28:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f310693e700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3100174c10 0x7f31000c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f310693e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f310018eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f310693e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f310017d490 0x7f310018f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f310693e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000ccde0 con 0x7f3100174ff0 2022-09-17T10:28:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f310693e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000ec480 con 0x7f310017d490 2022-09-17T10:28:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f310693e700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000cc260 con 0x7f3100174c10 2022-09-17T10:28:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f310018eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f310018eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39552/0 (socket says 172.21.15.62:39552) 2022-09-17T10:28:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 -- 172.21.15.62:0/3011658857 learned_addr learned my addr 172.21.15.62:0/3011658857 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30fffff700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3100174c10 0x7f31000c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 -- 172.21.15.62:0/3011658857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3100174c10 msgr2=0x7f31000c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3100174c10 0x7f31000c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 -- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f310017d490 msgr2=0x7f310018f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f310017d490 0x7f310018f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 -- 172.21.15.62:0/3011658857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0009370 con 0x7f3100174ff0 2022-09-17T10:28:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.479+0000 7f30ff7fe700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f310018eb10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f3100175600 tx=0x7f30f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.480+0000 7f30f7fff700 1 -- 172.21.15.62:0/3011658857 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000be90 con 0x7f3100174ff0 2022-09-17T10:28:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.480+0000 7f30f7fff700 1 -- 172.21.15.62:0/3011658857 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000b7f0 con 0x7f3100174ff0 2022-09-17T10:28:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.480+0000 7f30f7fff700 1 -- 172.21.15.62:0/3011658857 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f001c670 con 0x7f3100174ff0 2022-09-17T10:28:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.480+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31000cc540 con 0x7f3100174ff0 2022-09-17T10:28:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.480+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31000ccb00 con 0x7f3100174ff0 2022-09-17T10:28:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.481+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310017c6d0 con 0x7f3100174ff0 2022-09-17T10:28:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.481+0000 7f30f7fff700 1 -- 172.21.15.62:0/3011658857 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f30f002c070 con 0x7f3100174ff0 2022-09-17T10:28:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.482+0000 7f30f7fff700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f30e408ba40 0x7f30e408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.482+0000 7f30fffff700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f30e408ba40 0x7f30e408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.482+0000 7f30f7fff700 1 -- 172.21.15.62:0/3011658857 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f30f00b2630 con 0x7f3100174ff0 2022-09-17T10:28:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.483+0000 7f30fffff700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f30e408ba40 0x7f30e408df00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f30e80011e0 tx=0x7f30e8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.486+0000 7f30f7fff700 1 -- 172.21.15.62:0/3011658857 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f30f0083270 con 0x7f3100174ff0 2022-09-17T10:28:14.658 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.656+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f310006bf40 con 0x7f3100174ff0 2022-09-17T10:28:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.657+0000 7f30f7fff700 1 -- 172.21.15.62:0/3011658857 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7f30f002a020 con 0x7f3100174ff0 2022-09-17T10:28:14.659 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2022-09-17T10:28:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f30e408ba40 msgr2=0x7f30e408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f30e408ba40 0x7f30e408df00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f30e80011e0 tx=0x7f30e8009040).stop 2022-09-17T10:28:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 msgr2=0x7f310018eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f310018eb10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f3100175600 tx=0x7f30f0017000).stop 2022-09-17T10:28:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 shutdown_connections 2022-09-17T10:28:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f30e408ba40 0x7f30e408df00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f310017d490 0x7f310018f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3100174c10 0x7f31000c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 --2- 172.21.15.62:0/3011658857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3100174ff0 0x7f310018eb10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.658+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 >> 172.21.15.62:0/3011658857 conn(0x7f31000f4c90 msgr2=0x7f31001503b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.659+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 shutdown_connections 2022-09-17T10:28:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.659+0000 7f310693e700 1 -- 172.21.15.62:0/3011658857 wait complete. 2022-09-17T10:28:14.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-17T10:28:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.790+0000 7fe8a5446700 1 Processor -- start 2022-09-17T10:28:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.790+0000 7fe8a5446700 1 -- start start 2022-09-17T10:28:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.791+0000 7fe8a5446700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8a017df60 0x7fe8a0085d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.791+0000 7fe8a5446700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe8a017e340 0x7fe8a017f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.791+0000 7fe8a5446700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00858e0 con 0x7fe8a017fc50 2022-09-17T10:28:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.791+0000 7fe8a5446700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a0084a30 con 0x7fe8a017df60 2022-09-17T10:28:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe8a5446700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a00ee450 con 0x7fe8a017e340 2022-09-17T10:28:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8a017df60 0x7fe8a0085d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89effd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8a017df60 0x7fe8a0085d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39566/0 (socket says 172.21.15.62:39566) 2022-09-17T10:28:14.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89effd700 1 -- 172.21.15.62:0/567699593 learned_addr learned my addr 172.21.15.62:0/567699593 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:14.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89e7fc700 1 --2- 172.21.15.62:0/567699593 >> v2:172.21.15.93:3300/0 conn(0x7fe8a017e340 0x7fe8a017f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.798 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89effd700 1 -- 172.21.15.62:0/567699593 >> v2:172.21.15.93:3300/0 conn(0x7fe8a017e340 msgr2=0x7fe8a017f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89effd700 1 --2- 172.21.15.62:0/567699593 >> v2:172.21.15.93:3300/0 conn(0x7fe8a017e340 0x7fe8a017f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89effd700 1 -- 172.21.15.62:0/567699593 >> v1:172.21.15.159:6789/0 conn(0x7fe8a017fc50 legacy=0x7fe8a0181d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89effd700 1 -- 172.21.15.62:0/567699593 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0084cd0 con 0x7fe8a017df60 2022-09-17T10:28:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89effd700 1 --2- 172.21.15.62:0/567699593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017df60 0x7fe8a0085d70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fe8a0086fe0 tx=0x7fe8980090f0).ready entity=mon.0 client_cookie=6ec5f71852acb074 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89dffb700 1 -- 172.21.15.62:0/567699593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800b520 con 0x7fe8a017df60 2022-09-17T10:28:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89dffb700 1 -- 172.21.15.62:0/567699593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89800b680 con 0x7fe8a017df60 2022-09-17T10:28:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.792+0000 7fe89dffb700 1 -- 172.21.15.62:0/567699593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800ba00 con 0x7fe8a017df60 2022-09-17T10:28:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.793+0000 7fe8a5446700 1 -- 172.21.15.62:0/567699593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017df60 msgr2=0x7fe8a0085d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.793+0000 7fe8a5446700 1 --2- 172.21.15.62:0/567699593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017df60 0x7fe8a0085d70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fe8a0086fe0 tx=0x7fe8980090f0).stop 2022-09-17T10:28:14.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.793+0000 7fe8a5446700 1 -- 172.21.15.62:0/567699593 shutdown_connections 2022-09-17T10:28:14.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.793+0000 7fe8a5446700 1 --2- 172.21.15.62:0/567699593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017df60 0x7fe8a0085d70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.793+0000 7fe8a5446700 1 --2- 172.21.15.62:0/567699593 >> v2:172.21.15.93:3300/0 conn(0x7fe8a017e340 0x7fe8a017f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.793+0000 7fe8a5446700 1 -- 172.21.15.62:0/567699593 >> 172.21.15.62:0/567699593 conn(0x7fe8a00f2aa0 msgr2=0x7fe8a00f2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:14.801 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.793+0000 7fe8a5446700 1 -- 172.21.15.62:0/567699593 shutdown_connections 2022-09-17T10:28:14.802 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.793+0000 7fe8a5446700 1 -- 172.21.15.62:0/567699593 wait complete. 2022-09-17T10:28:14.805 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.795+0000 7fe8a5446700 1 Processor -- start 2022-09-17T10:28:14.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.795+0000 7fe8a5446700 1 -- start start 2022-09-17T10:28:14.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.795+0000 7fe8a5446700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017e340 0x7fe8a017cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.806 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe8a5446700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8a017fc50 0x7fe8a017d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.809 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe8a5446700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a00ec2b0 0x7fe8a00ec730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe8a5446700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a017cb20 con 0x7fe8a017e340 2022-09-17T10:28:14.810 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe8a5446700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a017bc30 con 0x7fe8a017fc50 2022-09-17T10:28:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe8a5446700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a017bf10 con 0x7fe8a00ec2b0 2022-09-17T10:28:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017e340 0x7fe8a017cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017e340 0x7fe8a017cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39576/0 (socket says 172.21.15.62:39576) 2022-09-17T10:28:14.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 -- 172.21.15.62:0/2936777492 learned_addr learned my addr 172.21.15.62:0/2936777492 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:14.812 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89f7fe700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a00ec2b0 0x7fe8a00ec730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89e7fc700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8a017fc50 0x7fe8a017d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 -- 172.21.15.62:0/2936777492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a00ec2b0 msgr2=0x7fe8a00ec730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a00ec2b0 0x7fe8a00ec730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 -- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8a017fc50 msgr2=0x7fe8a017d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8a017fc50 0x7fe8a017d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 -- 172.21.15.62:0/2936777492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898009370 con 0x7fe8a017e340 2022-09-17T10:28:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe89effd700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017e340 0x7fe8a017cfb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe898011000 tx=0x7fe898017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe896ffd700 1 -- 172.21.15.62:0/2936777492 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800bec0 con 0x7fe8a017e340 2022-09-17T10:28:14.818 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe896ffd700 1 -- 172.21.15.62:0/2936777492 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89800b7f0 con 0x7fe8a017e340 2022-09-17T10:28:14.818 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a017c1f0 con 0x7fe8a017e340 2022-09-17T10:28:14.819 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe896ffd700 1 -- 172.21.15.62:0/2936777492 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89801c650 con 0x7fe8a017e340 2022-09-17T10:28:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.796+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a017c7b0 con 0x7fe8a017e340 2022-09-17T10:28:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.797+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a017ce00 con 0x7fe8a017e340 2022-09-17T10:28:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.798+0000 7fe896ffd700 1 -- 172.21.15.62:0/2936777492 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fe89802c070 con 0x7fe8a017e340 2022-09-17T10:28:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.798+0000 7fe896ffd700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe88408ba40 0x7fe88408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.799+0000 7fe896ffd700 1 -- 172.21.15.62:0/2936777492 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fe8980b2530 con 0x7fe8a017e340 2022-09-17T10:28:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.799+0000 7fe89e7fc700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe88408ba40 0x7fe88408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.799+0000 7fe89e7fc700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe88408ba40 0x7fe88408df00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe8a0191ff0 tx=0x7fe888008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.802+0000 7fe896ffd700 1 -- 172.21.15.62:0/2936777492 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fe898083170 con 0x7fe8a017e340 2022-09-17T10:28:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.975+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8a006bf40 con 0x7fe8a017e340 2022-09-17T10:28:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.976+0000 7fe896ffd700 1 -- 172.21.15.62:0/2936777492 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe89802a020 con 0x7fe8a017e340 2022-09-17T10:28:14.979 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2022-09-17T10:28:14.981 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe88408ba40 msgr2=0x7fe88408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe88408ba40 0x7fe88408df00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe8a0191ff0 tx=0x7fe888008040).stop 2022-09-17T10:28:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017e340 msgr2=0x7fe8a017cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017e340 0x7fe8a017cfb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe898011000 tx=0x7fe898017000).stop 2022-09-17T10:28:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 shutdown_connections 2022-09-17T10:28:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fe88408ba40 0x7fe88408df00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a00ec2b0 0x7fe8a00ec730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a017e340 0x7fe8a017cfb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 --2- 172.21.15.62:0/2936777492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8a017fc50 0x7fe8a017d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.977+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 >> 172.21.15.62:0/2936777492 conn(0x7fe8a00f2aa0 msgr2=0x7fe8a00eec70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.978+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 shutdown_connections 2022-09-17T10:28:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:14.978+0000 7fe8a5446700 1 -- 172.21.15.62:0/2936777492 wait complete. 2022-09-17T10:28:14.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-09-17T10:28:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.113+0000 7fc9c7cd2700 1 Processor -- start 2022-09-17T10:28:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.114+0000 7fc9c7cd2700 1 -- start start 2022-09-17T10:28:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c7cd2700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc9c00683d0 0x7fc9c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c7cd2700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c006a2a0 con 0x7fc9c017e3c0 2022-09-17T10:28:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c7cd2700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c0068a30 con 0x7fc9c017dfe0 2022-09-17T10:28:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c7cd2700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c0068d10 con 0x7fc9c00683d0 2022-09-17T10:28:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c526d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc9c017e3c0 0x7fc9c0183130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.62:34234/0 (socket says 172.21.15.62:34234) 2022-09-17T10:28:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c526d700 1 -- 172.21.15.62:0/1151334801 learned_addr learned my addr 172.21.15.62:0/1151334801 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c626f700 1 --2- 172.21.15.62:0/1151334801 >> v2:172.21.15.93:3300/0 conn(0x7fc9c00683d0 0x7fc9c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c4a6c700 1 -- 172.21.15.62:0/1151334801 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014539913 0 0) 0x7fc9c006a2a0 con 0x7fc9c017e3c0 2022-09-17T10:28:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c4a6c700 1 -- 172.21.15.62:0/1151334801 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ac0033f0 con 0x7fc9c017e3c0 2022-09-17T10:28:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c4a6c700 1 -- 172.21.15.62:0/1151334801 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209520163 0 0) 0x7fc9c0068a30 con 0x7fc9c017dfe0 2022-09-17T10:28:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c4a6c700 1 -- 172.21.15.62:0/1151334801 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c006a2a0 con 0x7fc9c017dfe0 2022-09-17T10:28:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c626f700 1 -- 172.21.15.62:0/1151334801 >> v1:172.21.15.159:6789/0 conn(0x7fc9c017dfe0 legacy=0x7fc9c0084010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c626f700 1 -- 172.21.15.62:0/1151334801 >> v1:172.21.15.93:6789/0 conn(0x7fc9c017e3c0 legacy=0x7fc9c0183130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.115+0000 7fc9c626f700 1 -- 172.21.15.62:0/1151334801 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0068ff0 con 0x7fc9c00683d0 2022-09-17T10:28:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c626f700 1 --2- 172.21.15.62:0/1151334801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c00683d0 0x7fc9c0069db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc9b0009790 tx=0x7fc9b0009060).ready entity=mon.1 client_cookie=8aee828135bc1657 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c4a6c700 1 -- 172.21.15.62:0/1151334801 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0009120 con 0x7fc9c00683d0 2022-09-17T10:28:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c4a6c700 1 -- 172.21.15.62:0/1151334801 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b000d4a0 con 0x7fc9c00683d0 2022-09-17T10:28:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c4a6c700 1 -- 172.21.15.62:0/1151334801 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000d820 con 0x7fc9c00683d0 2022-09-17T10:28:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/1151334801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c00683d0 msgr2=0x7fc9c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c7cd2700 1 --2- 172.21.15.62:0/1151334801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c00683d0 0x7fc9c0069db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc9b0009790 tx=0x7fc9b0009060).stop 2022-09-17T10:28:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/1151334801 shutdown_connections 2022-09-17T10:28:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c7cd2700 1 --2- 172.21.15.62:0/1151334801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c00683d0 0x7fc9c0069db0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/1151334801 >> 172.21.15.62:0/1151334801 conn(0x7fc9c0062a40 msgr2=0x7fc9c00f2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/1151334801 shutdown_connections 2022-09-17T10:28:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.116+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/1151334801 wait complete. 2022-09-17T10:28:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.118+0000 7fc9c7cd2700 1 Processor -- start 2022-09-17T10:28:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.118+0000 7fc9c7cd2700 1 -- start start 2022-09-17T10:28:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c7cd2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9c00683d0 0x7fc9c016d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c7cd2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c017dfe0 0x7fc9c016de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c7cd2700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c017e3c0 0x7fc9c00f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c7cd2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0190210 con 0x7fc9c00683d0 2022-09-17T10:28:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c7cd2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00f1970 con 0x7fc9c017dfe0 2022-09-17T10:28:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c7cd2700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00f1c50 con 0x7fc9c017e3c0 2022-09-17T10:28:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9c00683d0 0x7fc9c016d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9c00683d0 0x7fc9c016d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39586/0 (socket says 172.21.15.62:39586) 2022-09-17T10:28:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 -- 172.21.15.62:0/3715850079 learned_addr learned my addr 172.21.15.62:0/3715850079 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c526d700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c017dfe0 0x7fc9c016de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c626f700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c017e3c0 0x7fc9c00f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 -- 172.21.15.62:0/3715850079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c017e3c0 msgr2=0x7fc9c00f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c017e3c0 0x7fc9c00f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 -- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c017dfe0 msgr2=0x7fc9c016de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c017dfe0 0x7fc9c016de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 -- 172.21.15.62:0/3715850079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b00092a0 con 0x7fc9c00683d0 2022-09-17T10:28:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c626f700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c017e3c0 0x7fc9c00f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c5a6e700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9c00683d0 0x7fc9c016d9a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fc9b800c7c0 tx=0x7fc9b80025c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9bdffb700 1 -- 172.21.15.62:0/3715850079 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8002030 con 0x7fc9c00683d0 2022-09-17T10:28:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9bdffb700 1 -- 172.21.15.62:0/3715850079 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8002190 con 0x7fc9c00683d0 2022-09-17T10:28:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.119+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c00f1f30 con 0x7fc9c00683d0 2022-09-17T10:28:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.120+0000 7fc9bdffb700 1 -- 172.21.15.62:0/3715850079 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8001550 con 0x7fc9c00683d0 2022-09-17T10:28:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.120+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c00f0f80 con 0x7fc9c00683d0 2022-09-17T10:28:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.121+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c006bf40 con 0x7fc9c00683d0 2022-09-17T10:28:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.121+0000 7fc9bdffb700 1 -- 172.21.15.62:0/3715850079 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fc9b8019030 con 0x7fc9c00683d0 2022-09-17T10:28:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.122+0000 7fc9bdffb700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc9a008ba40 0x7fc9a008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.122+0000 7fc9bdffb700 1 -- 172.21.15.62:0/3715850079 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc9b80afde0 con 0x7fc9c00683d0 2022-09-17T10:28:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.122+0000 7fc9c526d700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc9a008ba40 0x7fc9a008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.123+0000 7fc9c526d700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc9a008ba40 0x7fc9a008df00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fc9c00c8300 tx=0x7fc9b4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.143 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.126+0000 7fc9bdffb700 1 -- 172.21.15.62:0/3715850079 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7fc9b8080aa0 con 0x7fc9c00683d0 2022-09-17T10:28:15.301 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.298+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9c0083df0 con 0x7fc9c00683d0 2022-09-17T10:28:15.302 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.298+0000 7fc9bdffb700 1 -- 172.21.15.62:0/3715850079 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9b8017030 con 0x7fc9c00683d0 2022-09-17T10:28:15.303 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2022-09-17T10:28:15.305 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc9a008ba40 msgr2=0x7fc9a008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc9a008ba40 0x7fc9a008df00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fc9c00c8300 tx=0x7fc9b4009040).stop 2022-09-17T10:28:15.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9c00683d0 msgr2=0x7fc9c016d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9c00683d0 0x7fc9c016d9a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fc9b800c7c0 tx=0x7fc9b80025c0).stop 2022-09-17T10:28:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 shutdown_connections 2022-09-17T10:28:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fc9a008ba40 0x7fc9a008df00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c017e3c0 0x7fc9c00f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9c00683d0 0x7fc9c016d9a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 --2- 172.21.15.62:0/3715850079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c017dfe0 0x7fc9c016de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 >> 172.21.15.62:0/3715850079 conn(0x7fc9c0062a40 msgr2=0x7fc9c00c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:15.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 shutdown_connections 2022-09-17T10:28:15.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.300+0000 7fc9c7cd2700 1 -- 172.21.15.62:0/3715850079 wait complete. 2022-09-17T10:28:15.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-09-17T10:28:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.433+0000 7f4ad504b700 1 Processor -- start 2022-09-17T10:28:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.433+0000 7f4ad504b700 1 -- start start 2022-09-17T10:28:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.434+0000 7f4ad504b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4ad0062950 0x7f4ad0062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.434+0000 7f4ad504b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00c6dd0 con 0x7f4ad01751b0 2022-09-17T10:28:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.434+0000 7f4ad504b700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00642c0 con 0x7f4ad0175590 2022-09-17T10:28:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.434+0000 7f4ad504b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00f10e0 con 0x7f4ad0062950 2022-09-17T10:28:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4aced9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4ad01751b0 0x7f4ad0180670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35518/0 (socket says 172.21.15.62:35518) 2022-09-17T10:28:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4aced9d700 1 -- 172.21.15.62:0/2332865204 learned_addr learned my addr 172.21.15.62:0/2332865204 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acf59e700 1 --2- 172.21.15.62:0/2332865204 >> v2:172.21.15.93:3300/0 conn(0x7f4ad0062950 0x7f4ad0062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708573878 0 0) 0x7f4ad00c6dd0 con 0x7f4ad01751b0 2022-09-17T10:28:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ab00033f0 con 0x7f4ad01751b0 2022-09-17T10:28:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000356774 0 0) 0x7f4ab8001110 con 0x7f4ad0175590 2022-09-17T10:28:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad00c6dd0 con 0x7f4ad0175590 2022-09-17T10:28:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128537548 0 0) 0x7f4ab00033f0 con 0x7f4ad01751b0 2022-09-17T10:28:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 >> v2:172.21.15.93:3300/0 conn(0x7f4ad0062950 msgr2=0x7f4ad0062dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 --2- 172.21.15.62:0/2332865204 >> v2:172.21.15.93:3300/0 conn(0x7f4ad0062950 0x7f4ad0062dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 >> v1:172.21.15.159:6789/0 conn(0x7f4ad0175590 legacy=0x7f4ad0180d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad01801e0 con 0x7f4ad01751b0 2022-09-17T10:28:15.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2201617006 0 0) 0x7f4ac8001470 con 0x7f4ad01751b0 2022-09-17T10:28:15.453 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acf59e700 1 --2- 172.21.15.62:0/2332865204 >> v2:172.21.15.93:3300/0 conn(0x7f4ad0062950 0x7f4ad0062dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-09-17T10:28:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 >> v1:172.21.15.62:6789/0 conn(0x7f4ad01751b0 legacy=0x7f4ad0180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ab0003ac0 0x7f4ab0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ab0004690 0x7f4ab0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0005070 0x7f4ab000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00f10e0 con 0x7f4ab0004690 2022-09-17T10:28:15.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab000c010 con 0x7f4ab0003ac0 2022-09-17T10:28:15.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab000c1d0 con 0x7f4ab0005070 2022-09-17T10:28:15.455 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4ace59c700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ab0004690 0x7f4ab0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.435+0000 7f4aced9d700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ab0003ac0 0x7f4ab0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4acf59e700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0005070 0x7f4ab000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ace59c700 1 -- 172.21.15.62:0/2332865204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0005070 msgr2=0x7f4ab000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ace59c700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0005070 0x7f4ab000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ace59c700 1 -- 172.21.15.62:0/2332865204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ab0003ac0 msgr2=0x7f4ab0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:15.457 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ace59c700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ab0003ac0 0x7f4ab0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.457 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4acf59e700 1 -- 172.21.15.62:0/2332865204 reap_dead start 2022-09-17T10:28:15.457 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ace59c700 1 -- 172.21.15.62:0/2332865204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00033f0 con 0x7f4ab0004690 2022-09-17T10:28:15.457 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ace59c700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ab0004690 0x7f4ab0004b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f4ab8001a20 tx=0x7f4ab8007bb0).ready entity=mon.0 client_cookie=4d6f7b43ee4ec3af server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.458 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8007020 con 0x7f4ab0004690 2022-09-17T10:28:15.458 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab8007180 con 0x7f4ab0004690 2022-09-17T10:28:15.458 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4acdd9b700 1 -- 172.21.15.62:0/2332865204 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8007500 con 0x7f4ab0004690 2022-09-17T10:28:15.458 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ad504b700 1 -- 172.21.15.62:0/2332865204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ab0004690 msgr2=0x7f4ab0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.459 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ad504b700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ab0004690 0x7f4ab0004b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f4ab8001a20 tx=0x7f4ab8007bb0).stop 2022-09-17T10:28:15.459 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ad504b700 1 -- 172.21.15.62:0/2332865204 shutdown_connections 2022-09-17T10:28:15.459 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ad504b700 1 --2- 172.21.15.62:0/2332865204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ab0004690 0x7f4ab0004b10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.459 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.436+0000 7f4ad504b700 1 -- 172.21.15.62:0/2332865204 >> 172.21.15.62:0/2332865204 conn(0x7f4ad006a170 msgr2=0x7f4ad00f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:15.459 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.437+0000 7f4ad504b700 1 -- 172.21.15.62:0/2332865204 shutdown_connections 2022-09-17T10:28:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.437+0000 7f4ad504b700 1 -- 172.21.15.62:0/2332865204 wait complete. 2022-09-17T10:28:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.438+0000 7f4ad504b700 1 Processor -- start 2022-09-17T10:28:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.438+0000 7f4ad504b700 1 -- start start 2022-09-17T10:28:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.439+0000 7f4ad504b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0004690 0x7f4ad0083de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.439+0000 7f4ad504b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ad00842d0 0x7f4ad016dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.439+0000 7f4ad504b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad016e1b0 0x7f4ad0179b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.439+0000 7f4ad504b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00f0660 con 0x7f4ad016e1b0 2022-09-17T10:28:15.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.439+0000 7f4ad504b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0084da0 con 0x7f4ad00842d0 2022-09-17T10:28:15.461 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.439+0000 7f4ad504b700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0179700 con 0x7f4ab0004690 2022-09-17T10:28:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad016e1b0 0x7f4ad0179b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad016e1b0 0x7f4ad0179b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39604/0 (socket says 172.21.15.62:39604) 2022-09-17T10:28:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 -- 172.21.15.62:0/1802138112 learned_addr learned my addr 172.21.15.62:0/1802138112 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4ace59c700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ad00842d0 0x7f4ad016dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4aced9d700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0004690 0x7f4ad0083de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 -- 172.21.15.62:0/1802138112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0004690 msgr2=0x7f4ad0083de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0004690 0x7f4ad0083de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 -- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ad00842d0 msgr2=0x7f4ad016dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ad00842d0 0x7f4ad016dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 -- 172.21.15.62:0/1802138112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00847e0 con 0x7f4ad016e1b0 2022-09-17T10:28:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4ace59c700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ad00842d0 0x7f4ad016dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-17T10:28:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4acf59e700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad016e1b0 0x7f4ad0179b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f4ac00094d0 tx=0x7f4ac000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4ac6ffd700 1 -- 172.21.15.62:0/1802138112 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac000e040 con 0x7f4ad016e1b0 2022-09-17T10:28:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4ac6ffd700 1 -- 172.21.15.62:0/1802138112 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac000f040 con 0x7f4ad016e1b0 2022-09-17T10:28:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0084ac0 con 0x7f4ad016e1b0 2022-09-17T10:28:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4ac6ffd700 1 -- 172.21.15.62:0/1802138112 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0015450 con 0x7f4ad016e1b0 2022-09-17T10:28:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.440+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad0179390 con 0x7f4ad016e1b0 2022-09-17T10:28:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.441+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad0178f10 con 0x7f4ad016e1b0 2022-09-17T10:28:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.442+0000 7f4ac6ffd700 1 -- 172.21.15.62:0/1802138112 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f4ac00157c0 con 0x7f4ad016e1b0 2022-09-17T10:28:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.442+0000 7f4ac6ffd700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ab408ba10 0x7f4ab408ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.443+0000 7f4ac6ffd700 1 -- 172.21.15.62:0/1802138112 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f4ac00b1fe0 con 0x7f4ad016e1b0 2022-09-17T10:28:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.443+0000 7f4aced9d700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ab408ba10 0x7f4ab408ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.443+0000 7f4aced9d700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ab408ba10 0x7f4ab408ded0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4ac8000e10 tx=0x7f4ac8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.468 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.446+0000 7f4ac6ffd700 1 -- 172.21.15.62:0/1802138112 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f4ac0082c20 con 0x7f4ad016e1b0 2022-09-17T10:28:15.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.620+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ad0178ee0 con 0x7f4ad016e1b0 2022-09-17T10:28:15.623 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.620+0000 7f4ac6ffd700 1 -- 172.21.15.62:0/1802138112 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ac0086240 con 0x7f4ad016e1b0 2022-09-17T10:28:15.624 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2022-09-17T10:28:15.626 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ab408ba10 msgr2=0x7f4ab408ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ab408ba10 0x7f4ab408ded0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4ac8000e10 tx=0x7f4ac8009040).stop 2022-09-17T10:28:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad016e1b0 msgr2=0x7f4ad0179b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad016e1b0 0x7f4ad0179b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f4ac00094d0 tx=0x7f4ac000b040).stop 2022-09-17T10:28:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 shutdown_connections 2022-09-17T10:28:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f4ab408ba10 0x7f4ab408ded0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad016e1b0 0x7f4ad0179b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ab0004690 0x7f4ad0083de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 --2- 172.21.15.62:0/1802138112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ad00842d0 0x7f4ad016dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 >> 172.21.15.62:0/1802138112 conn(0x7f4ad006a170 msgr2=0x7f4ad0062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 shutdown_connections 2022-09-17T10:28:15.630 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.622+0000 7f4ad504b700 1 -- 172.21.15.62:0/1802138112 wait complete. 2022-09-17T10:28:15.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-09-17T10:28:15.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.754+0000 7f3c65f53700 1 Processor -- start 2022-09-17T10:28:15.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.754+0000 7f3c65f53700 1 -- start start 2022-09-17T10:28:15.771 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.755+0000 7f3c65f53700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3c60156c20 0x7f3c60067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.772 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.755+0000 7f3c65f53700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c600686a0 0x7f3c60062680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.772 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.755+0000 7f3c65f53700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c60066d20 con 0x7f3c60068220 2022-09-17T10:28:15.772 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.755+0000 7f3c65f53700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c60085210 con 0x7f3c600686a0 2022-09-17T10:28:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.755+0000 7f3c65f53700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c600678a0 con 0x7f3c60156c20 2022-09-17T10:28:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.755+0000 7f3c5ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c600686a0 0x7f3c60062680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.774 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c600686a0 0x7f3c60062680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39618/0 (socket says 172.21.15.62:39618) 2022-09-17T10:28:15.774 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5ffff700 1 -- 172.21.15.62:0/3006056865 learned_addr learned my addr 172.21.15.62:0/3006056865 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:15.774 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5f7fe700 1 --2- 172.21.15.62:0/3006056865 >> v2:172.21.15.93:3300/0 conn(0x7f3c60156c20 0x7f3c60067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.774 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5ffff700 1 -- 172.21.15.62:0/3006056865 >> v2:172.21.15.93:3300/0 conn(0x7f3c60156c20 msgr2=0x7f3c60067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:15.775 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5ffff700 1 --2- 172.21.15.62:0/3006056865 >> v2:172.21.15.93:3300/0 conn(0x7f3c60156c20 0x7f3c60067d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.775 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5ffff700 1 -- 172.21.15.62:0/3006056865 >> v1:172.21.15.93:6789/0 conn(0x7f3c60068220 legacy=0x7f3c60061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:15.775 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5ffff700 1 -- 172.21.15.62:0/3006056865 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60181690 con 0x7f3c600686a0 2022-09-17T10:28:15.776 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5ffff700 1 --2- 172.21.15.62:0/3006056865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c60062680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f3c58009f20 tx=0x7f3c58009840).ready entity=mon.0 client_cookie=29b039da3a8bf513 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.776 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5e7fc700 1 -- 172.21.15.62:0/3006056865 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800e070 con 0x7f3c600686a0 2022-09-17T10:28:15.776 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5e7fc700 1 -- 172.21.15.62:0/3006056865 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5800ba40 con 0x7f3c600686a0 2022-09-17T10:28:15.777 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.756+0000 7f3c5e7fc700 1 -- 172.21.15.62:0/3006056865 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800bdc0 con 0x7f3c600686a0 2022-09-17T10:28:15.777 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.757+0000 7f3c65f53700 1 -- 172.21.15.62:0/3006056865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 msgr2=0x7f3c60062680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.777 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.757+0000 7f3c65f53700 1 --2- 172.21.15.62:0/3006056865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c60062680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f3c58009f20 tx=0x7f3c58009840).stop 2022-09-17T10:28:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.757+0000 7f3c65f53700 1 -- 172.21.15.62:0/3006056865 shutdown_connections 2022-09-17T10:28:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.757+0000 7f3c65f53700 1 --2- 172.21.15.62:0/3006056865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c60062680 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.757+0000 7f3c65f53700 1 --2- 172.21.15.62:0/3006056865 >> v2:172.21.15.93:3300/0 conn(0x7f3c60156c20 0x7f3c60067d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.757+0000 7f3c65f53700 1 -- 172.21.15.62:0/3006056865 >> 172.21.15.62:0/3006056865 conn(0x7f3c6006a160 msgr2=0x7f3c6005d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.757+0000 7f3c65f53700 1 -- 172.21.15.62:0/3006056865 shutdown_connections 2022-09-17T10:28:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.757+0000 7f3c65f53700 1 -- 172.21.15.62:0/3006056865 wait complete. 2022-09-17T10:28:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.758+0000 7f3c65f53700 1 Processor -- start 2022-09-17T10:28:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.758+0000 7f3c65f53700 1 -- start start 2022-09-17T10:28:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c65f53700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c60068220 0x7f3c6018f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c65f53700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c601549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c65f53700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c60156c20 0x7f3c60154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c65f53700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6018f910 con 0x7f3c600686a0 2022-09-17T10:28:15.781 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c65f53700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60158fa0 con 0x7f3c60068220 2022-09-17T10:28:15.781 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c65f53700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600e8f00 con 0x7f3c60156c20 2022-09-17T10:28:15.781 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c5effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c601549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.781 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c5effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c601549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39628/0 (socket says 172.21.15.62:39628) 2022-09-17T10:28:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.759+0000 7f3c5effd700 1 -- 172.21.15.62:0/2312258517 learned_addr learned my addr 172.21.15.62:0/2312258517 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5f7fe700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c60068220 0x7f3c6018f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5ffff700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c60156c20 0x7f3c60154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5effd700 1 -- 172.21.15.62:0/2312258517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c60156c20 msgr2=0x7f3c60154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5effd700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c60156c20 0x7f3c60154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5effd700 1 -- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c60068220 msgr2=0x7f3c6018f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5effd700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c60068220 0x7f3c6018f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.784 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5effd700 1 -- 172.21.15.62:0/2312258517 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58009ae0 con 0x7f3c600686a0 2022-09-17T10:28:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5ffff700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c60156c20 0x7f3c60154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c5effd700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c601549c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f3c5400c470 tx=0x7f3c54007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c477fe700 1 -- 172.21.15.62:0/2312258517 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400f470 con 0x7f3c600686a0 2022-09-17T10:28:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c477fe700 1 -- 172.21.15.62:0/2312258517 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5400f5d0 con 0x7f3c600686a0 2022-09-17T10:28:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c60158420 con 0x7f3c600686a0 2022-09-17T10:28:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c477fe700 1 -- 172.21.15.62:0/2312258517 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400f970 con 0x7f3c600686a0 2022-09-17T10:28:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.760+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c601589e0 con 0x7f3c600686a0 2022-09-17T10:28:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.761+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c600e9090 con 0x7f3c600686a0 2022-09-17T10:28:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.762+0000 7f3c477fe700 1 -- 172.21.15.62:0/2312258517 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f3c54019030 con 0x7f3c600686a0 2022-09-17T10:28:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.762+0000 7f3c477fe700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c4008ba40 0x7f3c4008df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.763+0000 7f3c477fe700 1 -- 172.21.15.62:0/2312258517 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3c540afcc0 con 0x7f3c600686a0 2022-09-17T10:28:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.763+0000 7f3c5f7fe700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c4008ba40 0x7f3c4008df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:15.790 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.763+0000 7f3c5f7fe700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c4008ba40 0x7f3c4008df00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3c50006fd0 tx=0x7f3c50008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.766+0000 7f3c477fe700 1 -- 172.21.15.62:0/2312258517 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f3c54080900 con 0x7f3c600686a0 2022-09-17T10:28:15.944 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.941+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3c60066f70 con 0x7f3c600686a0 2022-09-17T10:28:15.945 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.941+0000 7f3c477fe700 1 -- 172.21.15.62:0/2312258517 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3c54017020 con 0x7f3c600686a0 2022-09-17T10:28:15.945 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2022-09-17T10:28:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.943+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c4008ba40 msgr2=0x7f3c4008df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.943+0000 7f3c65f53700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c4008ba40 0x7f3c4008df00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3c50006fd0 tx=0x7f3c50008040).stop 2022-09-17T10:28:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.943+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 msgr2=0x7f3c601549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.943+0000 7f3c65f53700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c601549c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f3c5400c470 tx=0x7f3c54007dc0).stop 2022-09-17T10:28:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.944+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 shutdown_connections 2022-09-17T10:28:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.944+0000 7f3c65f53700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f3c4008ba40 0x7f3c4008df00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.944+0000 7f3c65f53700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c60068220 0x7f3c6018f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.944+0000 7f3c65f53700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c60156c20 0x7f3c60154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.944+0000 7f3c65f53700 1 --2- 172.21.15.62:0/2312258517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c600686a0 0x7f3c601549c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.944+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 >> 172.21.15.62:0/2312258517 conn(0x7f3c6006a160 msgr2=0x7f3c6005da40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.944+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 shutdown_connections 2022-09-17T10:28:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:15.944+0000 7f3c65f53700 1 -- 172.21.15.62:0/2312258517 wait complete. 2022-09-17T10:28:15.959 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-09-17T10:28:15.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-17T10:28:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.073+0000 7f9f788a8700 1 Processor -- start 2022-09-17T10:28:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.073+0000 7f9f788a8700 1 -- start start 2022-09-17T10:28:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.074+0000 7f9f788a8700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9f740eb0d0 0x7f9f740b9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.074+0000 7f9f788a8700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f740ef740 con 0x7f9f74174fc0 2022-09-17T10:28:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.074+0000 7f9f788a8700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f740ed5b0 con 0x7f9f741753a0 2022-09-17T10:28:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.074+0000 7f9f788a8700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f74182b90 con 0x7f9f740eb0d0 2022-09-17T10:28:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.074+0000 7f9f72d9d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9f74174fc0 0x7f9f740ecda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.62:34246/0 (socket says 172.21.15.62:34246) 2022-09-17T10:28:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.074+0000 7f9f72d9d700 1 -- 172.21.15.62:0/609775916 learned_addr learned my addr 172.21.15.62:0/609775916 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.074+0000 7f9f7359e700 1 --2- 172.21.15.62:0/609775916 >> v2:172.21.15.159:3300/0 conn(0x7f9f740eb0d0 0x7f9f740b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f71d9b700 1 -- 172.21.15.62:0/609775916 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223147281 0 0) 0x7f9f740ef740 con 0x7f9f74174fc0 2022-09-17T10:28:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f71d9b700 1 -- 172.21.15.62:0/609775916 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f540033f0 con 0x7f9f74174fc0 2022-09-17T10:28:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f71d9b700 1 -- 172.21.15.62:0/609775916 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161892067 0 0) 0x7f9f740ed5b0 con 0x7f9f741753a0 2022-09-17T10:28:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f71d9b700 1 -- 172.21.15.62:0/609775916 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f740ef740 con 0x7f9f741753a0 2022-09-17T10:28:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f7359e700 1 -- 172.21.15.62:0/609775916 >> v1:172.21.15.159:6789/0 conn(0x7f9f741753a0 legacy=0x7f9f740ea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:16.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f7359e700 1 -- 172.21.15.62:0/609775916 >> v1:172.21.15.93:6789/0 conn(0x7f9f74174fc0 legacy=0x7f9f740ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:16.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f7359e700 1 -- 172.21.15.62:0/609775916 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740ed890 con 0x7f9f740eb0d0 2022-09-17T10:28:16.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f7359e700 1 --2- 172.21.15.62:0/609775916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740eb0d0 0x7f9f740b9f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9f64009e60 tx=0x7f9f64009780).ready entity=mon.2 client_cookie=cccd8cf1e28df685 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:16.086 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f71d9b700 1 -- 172.21.15.62:0/609775916 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400e070 con 0x7f9f740eb0d0 2022-09-17T10:28:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f71d9b700 1 -- 172.21.15.62:0/609775916 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6400bab0 con 0x7f9f740eb0d0 2022-09-17T10:28:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.075+0000 7f9f71d9b700 1 -- 172.21.15.62:0/609775916 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400be30 con 0x7f9f740eb0d0 2022-09-17T10:28:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.076+0000 7f9f788a8700 1 -- 172.21.15.62:0/609775916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740eb0d0 msgr2=0x7f9f740b9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.076+0000 7f9f788a8700 1 --2- 172.21.15.62:0/609775916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740eb0d0 0x7f9f740b9f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9f64009e60 tx=0x7f9f64009780).stop 2022-09-17T10:28:16.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.076+0000 7f9f788a8700 1 -- 172.21.15.62:0/609775916 shutdown_connections 2022-09-17T10:28:16.088 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.076+0000 7f9f788a8700 1 --2- 172.21.15.62:0/609775916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f740eb0d0 0x7f9f740b9f20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:16.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.076+0000 7f9f788a8700 1 -- 172.21.15.62:0/609775916 >> 172.21.15.62:0/609775916 conn(0x7f9f7405d9a0 msgr2=0x7f9f7405ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:16.089 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.076+0000 7f9f788a8700 1 -- 172.21.15.62:0/609775916 shutdown_connections 2022-09-17T10:28:16.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.076+0000 7f9f788a8700 1 -- 172.21.15.62:0/609775916 wait complete. 2022-09-17T10:28:16.090 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.077+0000 7f9f788a8700 1 Processor -- start 2022-09-17T10:28:16.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.077+0000 7f9f788a8700 1 -- start start 2022-09-17T10:28:16.091 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f788a8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f740eb0d0 0x7f9f740baa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:16.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f788a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74174fc0 0x7f9f74163400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:16.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f788a8700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f741753a0 0x7f9f7418e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:16.092 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f788a8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7418fde0 con 0x7f9f74174fc0 2022-09-17T10:28:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f788a8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740baf50 con 0x7f9f740eb0d0 2022-09-17T10:28:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f788a8700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7418f440 con 0x7f9f741753a0 2022-09-17T10:28:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f7259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74174fc0 0x7f9f74163400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f7259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74174fc0 0x7f9f74163400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39632/0 (socket says 172.21.15.62:39632) 2022-09-17T10:28:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.078+0000 7f9f7259c700 1 -- 172.21.15.62:0/1450632981 learned_addr learned my addr 172.21.15.62:0/1450632981 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f7359e700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f741753a0 0x7f9f7418e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f72d9d700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f740eb0d0 0x7f9f740baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f7259c700 1 -- 172.21.15.62:0/1450632981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f741753a0 msgr2=0x7f9f7418e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f7259c700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f741753a0 0x7f9f7418e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f7259c700 1 -- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f740eb0d0 msgr2=0x7f9f740baa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f7259c700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f740eb0d0 0x7f9f740baa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f7259c700 1 -- 172.21.15.62:0/1450632981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f64009a20 con 0x7f9f74174fc0 2022-09-17T10:28:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f7259c700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74174fc0 0x7f9f74163400 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f9f5c00c490 tx=0x7f9f5c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f6affd700 1 -- 172.21.15.62:0/1450632981 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00ce40 con 0x7f9f74174fc0 2022-09-17T10:28:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f6affd700 1 -- 172.21.15.62:0/1450632981 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c00f470 con 0x7f9f74174fc0 2022-09-17T10:28:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7418f720 con 0x7f9f74174fc0 2022-09-17T10:28:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f6affd700 1 -- 172.21.15.62:0/1450632981 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00f830 con 0x7f9f74174fc0 2022-09-17T10:28:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.079+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f74190310 con 0x7f9f74174fc0 2022-09-17T10:28:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.080+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7406be90 con 0x7f9f74174fc0 2022-09-17T10:28:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.081+0000 7f9f6affd700 1 -- 172.21.15.62:0/1450632981 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7f9f5c019030 con 0x7f9f74174fc0 2022-09-17T10:28:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.082+0000 7f9f6affd700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9f5808ba10 0x7f9f5808ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.082+0000 7f9f6affd700 1 -- 172.21.15.62:0/1450632981 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f9f5c0b0060 con 0x7f9f74174fc0 2022-09-17T10:28:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.082+0000 7f9f72d9d700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9f5808ba10 0x7f9f5808ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.082+0000 7f9f72d9d700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9f5808ba10 0x7f9f5808ded0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f9f6c005750 tx=0x7f9f6c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.085+0000 7f9f6affd700 1 -- 172.21.15.62:0/1450632981 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161982 (secure 0 0 0) 0x7f9f5c080ca0 con 0x7f9f74174fc0 2022-09-17T10:28:16.306 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.303+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f740edb70 con 0x7f9f74174fc0 2022-09-17T10:28:16.307 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.304+0000 7f9f6affd700 1 -- 172.21.15.62:0/1450632981 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+10539 (secure 0 0 0) 0x7f9f5c021030 con 0x7f9f74174fc0 2022-09-17T10:28:16.307 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-09-17T10:28:16.307 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/2161434381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2161434381},{"type":"v1","addr":"172.21.15.62:6833","nonce":2161434381}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/1194163827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":1194163827},{"type":"v1","addr":"172.21.15.62:6839","nonce":1194163827}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/413826247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":413826247},{"type":"v1","addr":"172.21.15.93:6835","nonce":413826247}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4325,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3152394380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3152394380},{"type":"v1","addr":"172.21.15.159:6836","nonce":3152394380}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2292269070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2292269070},{"type":"v1","addr":"172.21.15.62:6835","nonce":2292269070}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4327,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/301789402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":301789402},{"type":"v1","addr":"172.21.15.93:6837","nonce":301789402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4329,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1156565194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1156565194},{"type":"v1","addr":"172.21.15.62:6837","nonce":1156565194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4333,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6839/135709201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":135709201},{"type":"v1","addr":"172.21.15.93:6839","nonce":135709201}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4336,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6841/1241271614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6840","nonce":1241271614},{"type":"v1","addr":"172.21.15.93:6841","nonce":1241271614}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/426632534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":426632534},{"type":"v1","addr":"172.21.15.159:6833","nonce":426632534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-09-17T10:27:42.793084+0000","modified":"2022-09-17T10:27:59.962997+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4360":{"gid":4360,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/574611303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":574611303},{"type":"v1","addr":"172.21.15.159:6839","nonce":574611303}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4365":{"gid":4365,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/802951039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":802951039},{"type":"v1","addr":"172.21.15.159:6837","nonce":802951039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-09-17T10:28:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9f5808ba10 msgr2=0x7f9f5808ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9f5808ba10 0x7f9f5808ded0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f9f6c005750 tx=0x7f9f6c009040).stop 2022-09-17T10:28:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74174fc0 msgr2=0x7f9f74163400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:16.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74174fc0 0x7f9f74163400 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f9f5c00c490 tx=0x7f9f5c007c40).stop 2022-09-17T10:28:16.310 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 shutdown_connections 2022-09-17T10:28:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7f9f5808ba10 0x7f9f5808ded0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f740eb0d0 0x7f9f740baa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f741753a0 0x7f9f7418e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 --2- 172.21.15.62:0/1450632981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74174fc0 0x7f9f74163400 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 >> 172.21.15.62:0/1450632981 conn(0x7f9f7405d9a0 msgr2=0x7f9f740e4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.305+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 shutdown_connections 2022-09-17T10:28:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:16.306+0000 7f9f788a8700 1 -- 172.21.15.62:0/1450632981 wait complete. 2022-09-17T10:28:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 11 2022-09-17T10:28:17.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 50, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2022-09-17T10:27:42.793084+0000', 'modified': '2022-09-17T10:27:59.962997+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4360': {'gid': 4360, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.159:6839/574611303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 574611303}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 574611303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4365': {'gid': 4365, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6837/802951039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6835', 'nonce': 802951039}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 802951039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-09-17T10:28:17.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-09-17T10:28:17.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2022-09-17T10:28:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.660+0000 7fbc1aa6d700 1 Processor -- start 2022-09-17T10:28:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.660+0000 7fbc1aa6d700 1 -- start start 2022-09-17T10:28:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.661+0000 7fbc1aa6d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbc141751b0 0x7fbc14180670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.661+0000 7fbc1aa6d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc140c6dd0 con 0x7fbc14175590 2022-09-17T10:28:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.661+0000 7fbc1aa6d700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc141801e0 con 0x7fbc140ef650 2022-09-17T10:28:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.661+0000 7fbc1aa6d700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc140f10e0 con 0x7fbc141751b0 2022-09-17T10:28:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.661+0000 7fbc13fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbc14175590 0x7fbc14180b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35532/0 (socket says 172.21.15.62:35532) 2022-09-17T10:28:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.661+0000 7fbc13fff700 1 -- 172.21.15.62:0/3916995547 learned_addr learned my addr 172.21.15.62:0/3916995547 (peer_addr_for_me v1:172.21.15.62:0/0) 2022-09-17T10:28:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc18809700 1 --2- 172.21.15.62:0/3916995547 >> v2:172.21.15.93:3300/0 conn(0x7fbc141751b0 0x7fbc14180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc137fe700 1 -- 172.21.15.62:0/3916995547 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790180934 0 0) 0x7fbc140c6dd0 con 0x7fbc14175590 2022-09-17T10:28:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc137fe700 1 -- 172.21.15.62:0/3916995547 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc000033f0 con 0x7fbc14175590 2022-09-17T10:28:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc137fe700 1 -- 172.21.15.62:0/3916995547 <== mon.2 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850187612 0 0) 0x7fbc141801e0 con 0x7fbc140ef650 2022-09-17T10:28:17.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc137fe700 1 -- 172.21.15.62:0/3916995547 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc140c6dd0 con 0x7fbc140ef650 2022-09-17T10:28:17.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc137fe700 1 -- 172.21.15.62:0/3916995547 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4169965282 0 0) 0x7fbc000033f0 con 0x7fbc14175590 2022-09-17T10:28:17.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc18809700 1 -- 172.21.15.62:0/3916995547 >> v1:172.21.15.159:6789/0 conn(0x7fbc140ef650 legacy=0x7fbc140efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.687 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc18809700 1 -- 172.21.15.62:0/3916995547 >> v1:172.21.15.62:6789/0 conn(0x7fbc14175590 legacy=0x7fbc14180b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc18809700 1 -- 172.21.15.62:0/3916995547 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc140f0840 con 0x7fbc141751b0 2022-09-17T10:28:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc18809700 1 --2- 172.21.15.62:0/3916995547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc141751b0 0x7fbc14180670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fbc04009760 tx=0x7fbc04009060).ready entity=mon.1 client_cookie=a5d88f72c203c5e7 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc137fe700 1 -- 172.21.15.62:0/3916995547 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08001470 con 0x7fbc141751b0 2022-09-17T10:28:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc137fe700 1 -- 172.21.15.62:0/3916995547 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc040090d0 con 0x7fbc141751b0 2022-09-17T10:28:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.662+0000 7fbc137fe700 1 -- 172.21.15.62:0/3916995547 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04011610 con 0x7fbc141751b0 2022-09-17T10:28:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.663+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/3916995547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc141751b0 msgr2=0x7fbc14180670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.690 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.663+0000 7fbc1aa6d700 1 --2- 172.21.15.62:0/3916995547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc141751b0 0x7fbc14180670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fbc04009760 tx=0x7fbc04009060).stop 2022-09-17T10:28:17.690 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.663+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/3916995547 shutdown_connections 2022-09-17T10:28:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.663+0000 7fbc1aa6d700 1 --2- 172.21.15.62:0/3916995547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc141751b0 0x7fbc14180670 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.663+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/3916995547 >> 172.21.15.62:0/3916995547 conn(0x7fbc1406a170 msgr2=0x7fbc140f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:17.692 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.663+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/3916995547 shutdown_connections 2022-09-17T10:28:17.692 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.663+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/3916995547 wait complete. 2022-09-17T10:28:17.692 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.664+0000 7fbc1aa6d700 1 Processor -- start 2022-09-17T10:28:17.693 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.664+0000 7fbc1aa6d700 1 -- start start 2022-09-17T10:28:17.693 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.665+0000 7fbc1aa6d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc140ef650 0x7fbc140c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.665+0000 7fbc1aa6d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc141751b0 0x7fbc140c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.665+0000 7fbc1aa6d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc14175590 0x7fbc14085820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.665+0000 7fbc1aa6d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140ed1d0 con 0x7fbc141751b0 2022-09-17T10:28:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.665+0000 7fbc1aa6d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140ec020 con 0x7fbc14175590 2022-09-17T10:28:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.665+0000 7fbc1aa6d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140ec2e0 con 0x7fbc140ef650 2022-09-17T10:28:17.696 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc141751b0 0x7fbc140c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.696 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc141751b0 0x7fbc140c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39636/0 (socket says 172.21.15.62:39636) 2022-09-17T10:28:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 -- 172.21.15.62:0/2181385704 learned_addr learned my addr 172.21.15.62:0/2181385704 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc18809700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc140ef650 0x7fbc140c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc1900a700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc14175590 0x7fbc14085820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 -- 172.21.15.62:0/2181385704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc140ef650 msgr2=0x7fbc140c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc140ef650 0x7fbc140c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.698 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 -- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc14175590 msgr2=0x7fbc14085820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc14175590 0x7fbc14085820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 -- 172.21.15.62:0/2181385704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc040092a0 con 0x7fbc141751b0 2022-09-17T10:28:17.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc13fff700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc141751b0 0x7fbc140c7a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fbc0800c800 tx=0x7fbc08001a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:17.699 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc10ff9700 1 -- 172.21.15.62:0/2181385704 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08007170 con 0x7fbc141751b0 2022-09-17T10:28:17.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc10ff9700 1 -- 172.21.15.62:0/2181385704 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc080072d0 con 0x7fbc141751b0 2022-09-17T10:28:17.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/2181385704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc140ec5c0 con 0x7fbc141751b0 2022-09-17T10:28:17.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc10ff9700 1 -- 172.21.15.62:0/2181385704 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc080048c0 con 0x7fbc141751b0 2022-09-17T10:28:17.700 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.666+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/2181385704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc140ecb80 con 0x7fbc141751b0 2022-09-17T10:28:17.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.668+0000 7fbc10ff9700 1 -- 172.21.15.62:0/2181385704 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 112197+0+0 (secure 0 0 0) 0x7fbc08010070 con 0x7fbc141751b0 2022-09-17T10:28:17.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.669+0000 7fbc10ff9700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbbf408ba40 0x7fbbf408df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.669+0000 7fbc10ff9700 1 -- 172.21.15.62:0/2181385704 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fbc080b01f0 con 0x7fbc141751b0 2022-09-17T10:28:17.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.669+0000 7fbc18809700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbbf408ba40 0x7fbbf408df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.701 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.669+0000 7fbc18809700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbbf408ba40 0x7fbbf408df00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fbc04006e00 tx=0x7fbc04016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:17.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.670+0000 7fbc2c3f9b80 1 Processor -- start 2022-09-17T10:28:17.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.670+0000 7fbc2c3f9b80 1 -- start start 2022-09-17T10:28:17.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.671+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 0x55686f0de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.702 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.671+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 0x55686f12a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.671+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f0dc340 0x55686f0dc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.671+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f01ea50 con 0x55686f0dc340 2022-09-17T10:28:17.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.671+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f033900 con 0x55686f11a570 2022-09-17T10:28:17.703 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.671+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686effb0d0 con 0x55686f11a190 2022-09-17T10:28:17.704 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f0dc340 0x55686f0dc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.704 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f0dc340 0x55686f0dc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39640/0 (socket says 172.21.15.62:39640) 2022-09-17T10:28:17.704 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 -- 172.21.15.62:0/3989046649 learned_addr learned my addr 172.21.15.62:0/3989046649 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:17.704 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc13fff700 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 0x55686f12a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc18809700 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 0x55686f0de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 -- 172.21.15.62:0/3989046649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 msgr2=0x55686f0de1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:17.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 0x55686f0de1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 -- 172.21.15.62:0/3989046649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 msgr2=0x55686f12a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:17.705 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 0x55686f12a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 -- 172.21.15.62:0/3989046649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55686f0b3f70 con 0x55686f0dc340 2022-09-17T10:28:17.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbc1900a700 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f0dc340 0x55686f0dc7c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fbc0c003c30 tx=0x7fbc0c009040).ready entity=mon.0 client_cookie=9e20476d39e41be5 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:17.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbbf9ffb700 1 -- 172.21.15.62:0/3989046649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0030d0 con 0x55686f0dc340 2022-09-17T10:28:17.706 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbbf9ffb700 1 -- 172.21.15.62:0/3989046649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0c003230 con 0x55686f0dc340 2022-09-17T10:28:17.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.672+0000 7fbbf9ffb700 1 -- 172.21.15.62:0/3989046649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c001860 con 0x55686f0dc340 2022-09-17T10:28:17.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/3989046649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f0dc340 msgr2=0x55686f0dc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f0dc340 0x55686f0dc7c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fbc0c003c30 tx=0x7fbc0c009040).stop 2022-09-17T10:28:17.707 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/3989046649 shutdown_connections 2022-09-17T10:28:17.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f0dc340 0x55686f0dc7c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 0x55686f0de1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.708 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/3989046649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 0x55686f12a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/3989046649 >> 172.21.15.62:0/3989046649 conn(0x55686f0e0dd0 msgr2=0x55686f0e17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:17.709 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/3989046649 shutdown_connections 2022-09-17T10:28:17.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.673+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/3989046649 wait complete. 2022-09-17T10:28:17.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.674+0000 7fbc2c3f9b80 1 -- start start 2022-09-17T10:28:17.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.674+0000 7fbc2c3f9b80 1 Processor -- start 2022-09-17T10:28:17.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f0dc340 0x55686f1179f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.710 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f160810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 0x55686f10aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f161560 con 0x55686f11a190 2022-09-17T10:28:17.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f120600 con 0x55686f11a570 2022-09-17T10:28:17.711 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f116700 con 0x55686f0dc340 2022-09-17T10:28:17.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc2c3f9b80 10 client.0 ll_register_callbacks cb 0x55686f0a1360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-17T10:28:17.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39656/0 (socket says 172.21.15.62:39656) 2022-09-17T10:28:17.712 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 -- 172.21.15.62:0/813847913 learned_addr learned my addr 172.21.15.62:0/813847913 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:17.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc18809700 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f0dc340 0x55686f1179f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 -- 172.21.15.62:0/813847913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f0dc340 msgr2=0x55686f1179f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:17.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f0dc340 0x55686f1179f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 -- 172.21.15.62:0/813847913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 msgr2=0x55686f10aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:17.713 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc1900a700 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 0x55686f10aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 0x55686f10aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 -- 172.21.15.62:0/813847913 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c00f040 con 0x55686f11a190 2022-09-17T10:28:17.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbc13fff700 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f160810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fbc08084900 tx=0x7fbc08080f40).ready entity=mon.0 client_cookie=2ab5fefd7a181ce3 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:17.714 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.675+0000 7fbbeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2022-09-17T10:28:17.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbbeeffd700 1 -- 172.21.15.62:0/813847913 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08004e80 con 0x55686f11a190 2022-09-17T10:28:17.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbbeeffd700 1 -- 172.21.15.62:0/813847913 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fbc0808a4e0 con 0x55686f11a190 2022-09-17T10:28:17.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/813847913 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55686f0db710 con 0x55686f11a190 2022-09-17T10:28:17.715 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbbeeffd700 1 -- 172.21.15.62:0/813847913 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc080572d0 con 0x55686f11a190 2022-09-17T10:28:17.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 10 client.4899 fetch_fsmap learned FSMap version 11 2022-09-17T10:28:17.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/813847913 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x55686ee65990 con 0x55686f11a190 2022-09-17T10:28:17.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbbeeffd700 1 -- 172.21.15.62:0/813847913 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55686f0db710 con 0x55686f11a190 2022-09-17T10:28:17.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbbeeffd700 1 -- 172.21.15.62:0/813847913 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 11) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fbc0808a050 con 0x55686f11a190 2022-09-17T10:28:17.716 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 10 client.4899 fetch_fsmap finished waiting for FSMap version 11 2022-09-17T10:28:17.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 10 client.4899 resolve_mds: resolved name 'f' to daemon mds.f 2022-09-17T10:28:17.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 20 client.4899 populate_metadata read hostname 'smithi062' 2022-09-17T10:28:17.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55686f163b10 0x55686f16c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.717 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 4 client.4899 mds_command: new command op to 4365 tid=0[{"prefix": "get_command_descriptions"}] 2022-09-17T10:28:17.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/813847913 --> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55686f0297a0 con 0x55686f163b10 2022-09-17T10:28:17.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.676+0000 7fbc18809700 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55686f163b10 0x55686f16c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.677+0000 7fbbeeffd700 10 client.4899 ms_handle_connect on v2:172.21.15.159:6835/802951039 2022-09-17T10:28:17.718 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.677+0000 7fbc18809700 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55686f163b10 0x55686f16c9e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=91a2d6326cb02307 server_cookie=6710735ab5ca599f in_seq=0 out_seq=0 2022-09-17T10:28:17.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.677+0000 7fbbeeffd700 1 -- 172.21.15.62:0/813847913 <== mds.0 v2:172.21.15.159:6835/802951039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55686f0297a0 con 0x55686f163b10 2022-09-17T10:28:17.719 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.677+0000 7fbbeeffd700 10 client.4899 handle_command_reply: tid=0 2022-09-17T10:28:17.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.677+0000 7fbc2c3f9b80 1 client.4899 shutdown 2022-09-17T10:28:17.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/813847913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 msgr2=0x55686f160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f160810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fbc08084900 tx=0x7fbc08080f40).stop 2022-09-17T10:28:17.720 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/813847913 shutdown_connections 2022-09-17T10:28:17.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f11a570 0x55686f10aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55686f163b10 0x55686f16c9e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f0dc340 0x55686f1179f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.721 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/813847913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f160810 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbbeeffd700 0 client.4899 ms_handle_reset on v2:172.21.15.159:6835/802951039 2022-09-17T10:28:17.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/813847913 >> 172.21.15.62:0/813847913 conn(0x55686f0e0dd0 msgr2=0x55686f14fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:17.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/813847913 shutdown_connections 2022-09-17T10:28:17.722 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/813847913 wait complete. 2022-09-17T10:28:17.723 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.678+0000 7fbc2c3f9b80 20 client.4899 trim_cache size 0 max 16384 2022-09-17T10:28:17.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.695+0000 7fbc2c3f9b80 1 Processor -- start 2022-09-17T10:28:17.731 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.695+0000 7fbc2c3f9b80 1 -- start start 2022-09-17T10:28:17.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.695+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.695+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f0dc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.695+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a570 0x55686f10ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.732 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f1190b0 con 0x55686f11a190 2022-09-17T10:28:17.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f119af0 con 0x55686f0dc340 2022-09-17T10:28:17.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f11fbc0 con 0x55686f11a570 2022-09-17T10:28:17.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f0dc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f0dc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39660/0 (socket says 172.21.15.62:39660) 2022-09-17T10:28:17.733 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 -- 172.21.15.62:0/2118467799 learned_addr learned my addr 172.21.15.62:0/2118467799 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:17.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc18809700 1 --2- 172.21.15.62:0/2118467799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 -- 172.21.15.62:0/2118467799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a570 msgr2=0x55686f10ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:17.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 --2- 172.21.15.62:0/2118467799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a570 0x55686f10ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:17.734 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 -- 172.21.15.62:0/2118467799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 msgr2=0x55686f1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:17.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 --2- 172.21.15.62:0/2118467799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f1534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 -- 172.21.15.62:0/2118467799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55686eed4c80 con 0x55686f11a190 2022-09-17T10:28:17.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc13fff700 1 --2- 172.21.15.62:0/2118467799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f0dc720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fbc08001d10 tx=0x7fbc0808f000).ready entity=mon.0 client_cookie=32a509231762445d server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:17.735 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbbfa7fc700 1 -- 172.21.15.62:0/2118467799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08004e80 con 0x55686f11a190 2022-09-17T10:28:17.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbbfa7fc700 1 -- 172.21.15.62:0/2118467799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc08084e90 con 0x55686f11a190 2022-09-17T10:28:17.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbbfa7fc700 1 -- 172.21.15.62:0/2118467799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc080572d0 con 0x55686f11a190 2022-09-17T10:28:17.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/2118467799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 msgr2=0x55686f0dc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.736 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.696+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/2118467799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f0dc720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fbc08001d10 tx=0x7fbc0808f000).stop 2022-09-17T10:28:17.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/2118467799 shutdown_connections 2022-09-17T10:28:17.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/2118467799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/2118467799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a570 0x55686f10ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-09-17T10:28:17.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/2118467799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a190 0x55686f0dc720 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.737 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/2118467799 >> 172.21.15.62:0/2118467799 conn(0x55686f0e0dd0 msgr2=0x55686f153d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:17.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/2118467799 shutdown_connections 2022-09-17T10:28:17.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/2118467799 wait complete. 2022-09-17T10:28:17.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 -- start start 2022-09-17T10:28:17.738 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.697+0000 7fbc2c3f9b80 1 Processor -- start 2022-09-17T10:28:17.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.698+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f0dc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.698+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 0x55686f14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.698+0000 7fbc2c3f9b80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a570 0x55686f1168b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.739 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.698+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f146980 con 0x55686f11a570 2022-09-17T10:28:17.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.698+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f153d30 con 0x55686f0dc340 2022-09-17T10:28:17.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc2c3f9b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686f0e6a10 con 0x55686f11a190 2022-09-17T10:28:17.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc2c3f9b80 10 client.0 ll_register_callbacks cb 0x7fbc080b00c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-09-17T10:28:17.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a570 0x55686f1168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.740 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a570 0x55686f1168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39674/0 (socket says 172.21.15.62:39674) 2022-09-17T10:28:17.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 -- 172.21.15.62:0/1098522393 learned_addr learned my addr 172.21.15.62:0/1098522393 (peer_addr_for_me v2:172.21.15.62:0/0) 2022-09-17T10:28:17.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc13fff700 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 0x55686f14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc18809700 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f0dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.741 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 -- 172.21.15.62:0/1098522393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 msgr2=0x55686f14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:17.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 0x55686f14ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 -- 172.21.15.62:0/1098522393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 msgr2=0x55686f0dc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-17T10:28:17.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f0dc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.742 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 -- 172.21.15.62:0/1098522393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55686ee65990 con 0x55686f11a570 2022-09-17T10:28:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc18809700 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f0dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-09-17T10:28:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc1900a700 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a570 0x55686f1168b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fbc0c003c00 tx=0x7fbc0c017000).ready entity=mon.0 client_cookie=b15391ad05b66617 server_cookie=0 in_seq=0 out_seq=0 2022-09-17T10:28:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbbeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2022-09-17T10:28:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbbeeffd700 1 -- 172.21.15.62:0/1098522393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c001860 con 0x55686f11a570 2022-09-17T10:28:17.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbbeeffd700 1 -- 172.21.15.62:0/1098522393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fbc0c001e20 con 0x55686f11a570 2022-09-17T10:28:17.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/1098522393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc0c003230 con 0x55686f11a570 2022-09-17T10:28:17.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbbeeffd700 1 -- 172.21.15.62:0/1098522393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc0c006c30 con 0x55686f11a570 2022-09-17T10:28:17.744 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc2c3f9b80 10 client.4905 fetch_fsmap learned FSMap version 11 2022-09-17T10:28:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.699+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/1098522393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x55686eea2f80 con 0x55686f11a570 2022-09-17T10:28:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbbeeffd700 1 -- 172.21.15.62:0/1098522393 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0c003230 con 0x55686f11a570 2022-09-17T10:28:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbbeeffd700 1 -- 172.21.15.62:0/1098522393 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 11) v1 ==== 7456+0+0 (secure 0 0 0) 0x7fbc0c007030 con 0x55686f11a570 2022-09-17T10:28:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbc2c3f9b80 10 client.4905 fetch_fsmap finished waiting for FSMap version 11 2022-09-17T10:28:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbc2c3f9b80 10 client.4905 resolve_mds: resolved name 'f' to daemon mds.f 2022-09-17T10:28:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbc2c3f9b80 20 client.4905 populate_metadata read hostname 'smithi062' 2022-09-17T10:28:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55686f1b9020 0x55686f1b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-09-17T10:28:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbc2c3f9b80 4 client.4905 mds_command: new command op to 4365 tid=0[{"prefix": "status"}] 2022-09-17T10:28:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/1098522393 --> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55686f020640 con 0x55686f1b9020 2022-09-17T10:28:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.700+0000 7fbc18809700 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55686f1b9020 0x55686f1b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-09-17T10:28:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbbeeffd700 10 client.4905 ms_handle_connect on v2:172.21.15.159:6835/802951039 2022-09-17T10:28:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc18809700 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55686f1b9020 0x55686f1b9400 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2998f7e64d130873 server_cookie=4fcf810a41050500 in_seq=0 out_seq=0 2022-09-17T10:28:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbbeeffd700 1 -- 172.21.15.62:0/1098522393 <== mds.0 v2:172.21.15.159:6835/802951039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55686f020640 con 0x55686f1b9020 2022-09-17T10:28:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbbeeffd700 10 client.4905 handle_command_reply: tid=0 2022-09-17T10:28:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 client.4905 shutdown 2022-09-17T10:28:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/1098522393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a570 msgr2=0x55686f1168b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a570 0x55686f1168b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fbc0c003c00 tx=0x7fbc0c017000).stop 2022-09-17T10:28:17.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/1098522393 shutdown_connections 2022-09-17T10:28:17.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55686f0dc340 0x55686f0dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.159:6835/802951039,v1:172.21.15.159:6837/802951039] conn(0x55686f1b9020 0x55686f1b9400 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55686f11a570 0x55686f1168b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.749 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 --2- 172.21.15.62:0/1098522393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55686f11a190 0x55686f14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbbeeffd700 0 client.4905 ms_handle_reset on v2:172.21.15.159:6835/802951039 2022-09-17T10:28:17.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/1098522393 >> 172.21.15.62:0/1098522393 conn(0x55686f0e0dd0 msgr2=0x55686f118320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:17.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/1098522393 shutdown_connections 2022-09-17T10:28:17.750 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 1 -- 172.21.15.62:0/1098522393 wait complete. 2022-09-17T10:28:17.751 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.701+0000 7fbc2c3f9b80 20 client.4905 trim_cache size 0 max 16384 2022-09-17T10:28:17.751 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2022-09-17T10:28:17.752 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "caff66e9-e5bf-4b11-8278-68b3c904b131", 2022-09-17T10:28:17.752 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2022-09-17T10:28:17.752 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4365, 2022-09-17T10:28:17.752 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2022-09-17T10:28:17.753 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2022-09-17T10:28:17.753 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2022-09-17T10:28:17.753 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 34.907630210999997, 2022-09-17T10:28:17.753 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 11, 2022-09-17T10:28:17.753 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 31, 2022-09-17T10:28:17.754 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 31, 2022-09-17T10:28:17.754 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 40.147831809000003 2022-09-17T10:28:17.754 INFO:teuthology.orchestra.run.smithi062.stdout:} 2022-09-17T10:28:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbbf408ba40 msgr2=0x7fbbf408df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbbf408ba40 0x7fbbf408df00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fbc04006e00 tx=0x7fbc04016000).stop 2022-09-17T10:28:17.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/2181385704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc141751b0 msgr2=0x7fbc140c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-17T10:28:17.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc141751b0 0x7fbc140c7a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fbc0800c800 tx=0x7fbc08001a60).stop 2022-09-17T10:28:17.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/2181385704 shutdown_connections 2022-09-17T10:28:17.757 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:6832/81423,v1:172.21.15.93:6833/81423] conn(0x7fbbf408ba40 0x7fbbf408df00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc14175590 0x7fbc14085820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc140ef650 0x7fbc140c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 --2- 172.21.15.62:0/2181385704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc141751b0 0x7fbc140c7a50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-09-17T10:28:17.758 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/2181385704 >> 172.21.15.62:0/2181385704 conn(0x7fbc1406a170 msgr2=0x7fbc140f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-17T10:28:17.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/2181385704 shutdown_connections 2022-09-17T10:28:17.759 INFO:teuthology.orchestra.run.smithi062.stderr:2022-09-17T10:28:17.702+0000 7fbc1aa6d700 1 -- 172.21.15.62:0/2181385704 wait complete. 2022-09-17T10:28:17.759 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2022-09-17T10:28:17.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:17.760 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p /home/ubuntu/cephtest/mnt.0 2022-09-17T10:28:17.777 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-09-17T10:28:17.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes,nowsync 2022-09-17T10:28:17.858 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes,nowsync 2022-09-17T10:28:17.859 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes,nowsync" will pass to kernel. 2022-09-17T10:28:17.964 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes,nowsync 2022-09-17T10:28:17.965 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes,nowsync" will pass to kernel. 2022-09-17T10:28:17.970 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-09-17T10:28:17.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-09-17T10:28:17.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-09-17T10:28:18.035 INFO:teuthology.run_tasks:Running task check-counter... 2022-09-17T10:28:18.046 INFO:teuthology.run_tasks:Running task workunit... 2022-09-17T10:28:18.061 INFO:tasks.workunit:Pulling workunits from ref 9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:28:18.062 INFO:tasks.workunit:Making a separate scratch dir for every client... 2022-09-17T10:28:18.063 INFO:tasks.workunit:timeout=3h 2022-09-17T10:28:18.063 INFO:tasks.workunit:cleanup=True 2022-09-17T10:28:18.064 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2022-09-17T10:28:18.091 INFO:teuthology.orchestra.run.smithi062.stdout: File: /home/ubuntu/cephtest/mnt.0 2022-09-17T10:28:18.092 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-09-17T10:28:18.092 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 2fh/47d Inode: 1 Links: 2 2022-09-17T10:28:18.092 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-17T10:28:18.093 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:cephfs_t:s0 2022-09-17T10:28:18.093 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-09-17T10:28:18.093 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2022-09-17 10:27:42.795900244 +0000 2022-09-17T10:28:18.094 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2022-09-17 10:27:55.771201480 +0000 2022-09-17T10:28:18.094 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2022-09-17T10:28:18.094 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2022-09-17T10:28:18.095 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2022-09-17T10:28:18.162 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9f1013ad23aaca59f081f4d35bc048be3d0598b7 2022-09-17T10:28:18.217 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2022-09-17T10:28:24.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:28:24.008 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:28:24.011 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:28:54.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:28:54.088 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:28:54.091 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:29:12.497 INFO:tasks.workunit.client.0.smithi062.stderr:Updating files: 69% (8088/11566) Updating files: 70% (8097/11566) Updating files: 71% (8212/11566) Updating files: 72% (8328/11566) Updating files: 73% (8444/11566) Updating files: 74% (8559/11566) Updating files: 75% (8675/11566) Updating files: 76% (8791/11566) Updating files: 77% (8906/11566) Updating files: 78% (9022/11566) Updating files: 79% (9138/11566) Updating files: 80% (9253/11566) Updating files: 81% (9369/11566) Updating files: 82% (9485/11566) Updating files: 83% (9600/11566) Updating files: 84% (9716/11566) Updating files: 85% (9832/11566) Updating files: 85% (9945/11566) Updating files: 86% (9947/11566) Updating files: 87% (10063/11566) Updating files: 88% (10179/11566) Updating files: 89% (10294/11566) Updating files: 90% (10410/11566) Updating files: 91% (10526/11566) Updating files: 92% (10641/11566) Updating files: 93% (10757/11566) Updating files: 94% (10873/11566) Updating files: 95% (10988/11566) Updating files: 96% (11104/11566) Updating files: 97% (11220/11566) Updating files: 98% (11335/11566) Updating files: 99% (11451/11566) Updating files: 100% (11566/11566) Updating files: 100% (11566/11566), done. 2022-09-17T10:29:13.304 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '9f1013ad23aaca59f081f4d35bc048be3d0598b7'. 2022-09-17T10:29:13.304 INFO:tasks.workunit.client.0.smithi062.stderr: 2022-09-17T10:29:13.305 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-09-17T10:29:13.305 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2022-09-17T10:29:13.305 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2022-09-17T10:29:13.305 INFO:tasks.workunit.client.0.smithi062.stderr: 2022-09-17T10:29:13.306 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2022-09-17T10:29:13.306 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2022-09-17T10:29:13.306 INFO:tasks.workunit.client.0.smithi062.stderr: 2022-09-17T10:29:13.306 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2022-09-17T10:29:13.307 INFO:tasks.workunit.client.0.smithi062.stderr: 2022-09-17T10:29:13.307 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2022-09-17T10:29:13.307 INFO:tasks.workunit.client.0.smithi062.stderr: 2022-09-17T10:29:13.307 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2022-09-17T10:29:13.307 INFO:tasks.workunit.client.0.smithi062.stderr: 2022-09-17T10:29:13.308 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-09-17T10:29:13.308 INFO:tasks.workunit.client.0.smithi062.stderr: 2022-09-17T10:29:13.308 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 9f1013ad23a Merge pull request #47823 from zdover23/wip-doc-2022-08-27-backport-47810-to-pacific 2022-09-17T10:29:13.312 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2022-09-17T10:29:13.898 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-09-17T10:29:13.900 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-09-17T10:29:13.900 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-09-17T10:29:16.683 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-09-17T10:29:16.755 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-09-17T10:29:16.793 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-09-17T10:29:16.794 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-09-17T10:29:16.795 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-09-17T10:29:16.832 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-09-17T10:29:16.835 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2022-09-17T10:29:16.836 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2022-09-17T10:29:16.851 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2022-09-17T10:29:16.854 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2022-09-17T10:29:16.855 DEBUG:teuthology.orchestra.run.smithi062:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9f1013ad23aaca59f081f4d35bc048be3d0598b7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2022-09-17T10:29:16.925 INFO:tasks.workunit.client.0.smithi062.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2022-09-17T10:29:16.926 INFO:tasks.workunit.client.0.smithi062.stdout: 2022-09-17T10:29:16.926 INFO:tasks.workunit.client.0.smithi062.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2022-09-17T10:29:16.927 INFO:tasks.workunit.client.0.smithi062.stdout:0 of 1 processes prepared for launch 0 sec 2022-09-17T10:29:17.027 INFO:tasks.workunit.client.0.smithi062.stdout:1 of 1 processes prepared for launch 0 sec 2022-09-17T10:29:17.028 INFO:tasks.workunit.client.0.smithi062.stdout:releasing clients 2022-09-17T10:29:18.026 INFO:tasks.workunit.client.0.smithi062.stdout: 1 2895 32.82 MB/sec warmup 1 sec latency 9.239 ms 2022-09-17T10:29:19.026 INFO:tasks.workunit.client.0.smithi062.stdout: 1 4777 21.09 MB/sec warmup 2 sec latency 24.497 ms 2022-09-17T10:29:20.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 7695 19.74 MB/sec warmup 3 sec latency 7.328 ms 2022-09-17T10:29:21.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 10762 19.24 MB/sec warmup 4 sec latency 8.758 ms 2022-09-17T10:29:22.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 12999 17.05 MB/sec warmup 5 sec latency 21.500 ms 2022-09-17T10:29:23.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 14519 16.19 MB/sec warmup 6 sec latency 102.091 ms 2022-09-17T10:29:24.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 17123 15.71 MB/sec warmup 7 sec latency 21.733 ms 2022-09-17T10:29:24.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:29:24.445 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:29:24.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:29:25.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 18478 14.61 MB/sec warmup 8 sec latency 111.217 ms 2022-09-17T10:29:26.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 21421 14.92 MB/sec warmup 9 sec latency 11.264 ms 2022-09-17T10:29:27.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 23387 14.14 MB/sec warmup 10 sec latency 16.652 ms 2022-09-17T10:29:28.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 25483 14.08 MB/sec warmup 11 sec latency 14.876 ms 2022-09-17T10:29:29.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 28167 14.10 MB/sec warmup 12 sec latency 64.480 ms 2022-09-17T10:29:30.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 29475 13.53 MB/sec warmup 13 sec latency 86.260 ms 2022-09-17T10:29:31.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 32337 13.79 MB/sec warmup 14 sec latency 16.305 ms 2022-09-17T10:29:32.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 34864 13.66 MB/sec warmup 15 sec latency 26.650 ms 2022-09-17T10:29:33.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 36501 13.32 MB/sec warmup 16 sec latency 14.676 ms 2022-09-17T10:29:34.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 39415 13.61 MB/sec warmup 17 sec latency 13.749 ms 2022-09-17T10:29:35.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 41258 13.17 MB/sec warmup 18 sec latency 113.420 ms 2022-09-17T10:29:36.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 43304 13.19 MB/sec warmup 19 sec latency 14.011 ms 2022-09-17T10:29:37.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 46232 13.41 MB/sec warmup 20 sec latency 13.175 ms 2022-09-17T10:29:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 48328 13.11 MB/sec warmup 21 sec latency 10.487 ms 2022-09-17T10:29:39.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 50281 13.12 MB/sec warmup 22 sec latency 70.520 ms 2022-09-17T10:29:40.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 53306 13.32 MB/sec warmup 23 sec latency 10.248 ms 2022-09-17T10:29:41.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 54516 12.92 MB/sec warmup 24 sec latency 102.640 ms 2022-09-17T10:29:42.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 57215 13.08 MB/sec warmup 25 sec latency 11.427 ms 2022-09-17T10:29:43.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 59776 13.06 MB/sec warmup 26 sec latency 10.394 ms 2022-09-17T10:29:44.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 61483 12.89 MB/sec warmup 27 sec latency 19.878 ms 2022-09-17T10:29:45.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 64234 13.04 MB/sec warmup 28 sec latency 21.472 ms 2022-09-17T10:29:46.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 66802 13.02 MB/sec warmup 29 sec latency 8.337 ms 2022-09-17T10:29:47.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 68294 12.83 MB/sec warmup 30 sec latency 132.848 ms 2022-09-17T10:29:48.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 71122 12.97 MB/sec warmup 31 sec latency 72.384 ms 2022-09-17T10:29:49.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 73096 12.79 MB/sec warmup 32 sec latency 76.660 ms 2022-09-17T10:29:50.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 74990 12.81 MB/sec warmup 33 sec latency 93.994 ms 2022-09-17T10:29:51.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 77444 12.78 MB/sec warmup 34 sec latency 43.064 ms 2022-09-17T10:29:52.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 78809 12.63 MB/sec warmup 35 sec latency 91.174 ms 2022-09-17T10:29:53.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 80554 12.48 MB/sec warmup 36 sec latency 117.311 ms 2022-09-17T10:29:54.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 82319 12.46 MB/sec warmup 37 sec latency 81.618 ms 2022-09-17T10:29:54.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:29:54.762 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:29:54.765 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:29:55.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 84403 12.42 MB/sec warmup 38 sec latency 100.873 ms 2022-09-17T10:29:56.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 85858 12.31 MB/sec warmup 39 sec latency 83.765 ms 2022-09-17T10:29:57.027 INFO:tasks.workunit.client.0.smithi062.stdout: 1 88516 12.36 MB/sec warmup 40 sec latency 39.316 ms 2022-09-17T10:29:58.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 89852 12.22 MB/sec warmup 41 sec latency 50.958 ms 2022-09-17T10:29:59.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 92595 12.33 MB/sec warmup 42 sec latency 59.374 ms 2022-09-17T10:30:00.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 95036 12.31 MB/sec warmup 43 sec latency 10.836 ms 2022-09-17T10:30:01.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 96730 12.23 MB/sec warmup 44 sec latency 18.687 ms 2022-09-17T10:30:02.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 99617 12.36 MB/sec warmup 45 sec latency 17.556 ms 2022-09-17T10:30:03.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 101802 12.25 MB/sec warmup 46 sec latency 13.773 ms 2022-09-17T10:30:04.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 103506 12.25 MB/sec warmup 47 sec latency 59.567 ms 2022-09-17T10:30:05.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 106083 12.27 MB/sec warmup 48 sec latency 89.699 ms 2022-09-17T10:30:06.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 107605 12.18 MB/sec warmup 49 sec latency 21.058 ms 2022-09-17T10:30:07.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 110309 12.27 MB/sec warmup 50 sec latency 21.702 ms 2022-09-17T10:30:08.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 112400 12.17 MB/sec warmup 51 sec latency 102.019 ms 2022-09-17T10:30:09.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 112497 11.95 MB/sec warmup 52 sec latency 884.443 ms 2022-09-17T10:30:10.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 113932 11.94 MB/sec warmup 53 sec latency 1051.766 ms 2022-09-17T10:30:11.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 116145 11.87 MB/sec warmup 54 sec latency 52.067 ms 2022-09-17T10:30:12.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 117766 11.86 MB/sec warmup 55 sec latency 41.491 ms 2022-09-17T10:30:13.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 120627 11.96 MB/sec warmup 56 sec latency 13.316 ms 2022-09-17T10:30:14.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 122163 11.87 MB/sec warmup 57 sec latency 39.865 ms 2022-09-17T10:30:15.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 124627 11.90 MB/sec warmup 58 sec latency 37.181 ms 2022-09-17T10:30:16.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 127202 11.91 MB/sec warmup 59 sec latency 11.557 ms 2022-09-17T10:30:17.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 128906 11.86 MB/sec warmup 60 sec latency 13.812 ms 2022-09-17T10:30:18.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 131656 11.94 MB/sec warmup 61 sec latency 8.840 ms 2022-09-17T10:30:19.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 133848 11.88 MB/sec warmup 62 sec latency 11.552 ms 2022-09-17T10:30:20.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 135610 11.87 MB/sec warmup 63 sec latency 23.764 ms 2022-09-17T10:30:21.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 138525 11.96 MB/sec warmup 64 sec latency 23.666 ms 2022-09-17T10:30:22.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 140752 11.90 MB/sec warmup 65 sec latency 22.998 ms 2022-09-17T10:30:23.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 142643 11.91 MB/sec warmup 66 sec latency 11.409 ms 2022-09-17T10:30:24.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 145533 11.99 MB/sec warmup 67 sec latency 12.862 ms 2022-09-17T10:30:25.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:30:25.006 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:30:25.010 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:30:25.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 146333 11.85 MB/sec warmup 68 sec latency 232.260 ms 2022-09-17T10:30:26.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 149143 11.93 MB/sec warmup 69 sec latency 52.285 ms 2022-09-17T10:30:27.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 151260 11.86 MB/sec warmup 70 sec latency 10.433 ms 2022-09-17T10:30:28.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 153150 11.88 MB/sec warmup 71 sec latency 12.426 ms 2022-09-17T10:30:29.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 154613 11.79 MB/sec warmup 72 sec latency 155.350 ms 2022-09-17T10:30:30.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 156435 11.81 MB/sec warmup 73 sec latency 184.705 ms 2022-09-17T10:30:31.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 158440 11.75 MB/sec warmup 74 sec latency 44.005 ms 2022-09-17T10:30:32.028 INFO:tasks.workunit.client.0.smithi062.stdout: 1 160361 11.76 MB/sec warmup 75 sec latency 24.024 ms 2022-09-17T10:30:33.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 163263 11.83 MB/sec warmup 76 sec latency 12.125 ms 2022-09-17T10:30:34.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 165274 11.77 MB/sec warmup 77 sec latency 9.355 ms 2022-09-17T10:30:35.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 167416 11.79 MB/sec warmup 78 sec latency 10.828 ms 2022-09-17T10:30:36.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 169744 11.80 MB/sec warmup 79 sec latency 105.772 ms 2022-09-17T10:30:37.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 171451 11.76 MB/sec warmup 80 sec latency 10.002 ms 2022-09-17T10:30:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 174190 11.83 MB/sec warmup 81 sec latency 19.736 ms 2022-09-17T10:30:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 176715 11.83 MB/sec warmup 82 sec latency 8.273 ms 2022-09-17T10:30:40.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 178355 11.78 MB/sec warmup 83 sec latency 10.099 ms 2022-09-17T10:30:41.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 181206 11.86 MB/sec warmup 84 sec latency 19.801 ms 2022-09-17T10:30:42.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 183367 11.80 MB/sec warmup 85 sec latency 26.543 ms 2022-09-17T10:30:43.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 185193 11.81 MB/sec warmup 86 sec latency 9.935 ms 2022-09-17T10:30:44.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 187985 11.87 MB/sec warmup 87 sec latency 29.872 ms 2022-09-17T10:30:45.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 189781 11.82 MB/sec warmup 88 sec latency 12.029 ms 2022-09-17T10:30:46.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 192135 11.84 MB/sec warmup 89 sec latency 11.063 ms 2022-09-17T10:30:47.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 194918 11.87 MB/sec warmup 90 sec latency 12.066 ms 2022-09-17T10:30:48.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 196788 11.85 MB/sec warmup 91 sec latency 9.559 ms 2022-09-17T10:30:49.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 199227 11.87 MB/sec warmup 92 sec latency 9.885 ms 2022-09-17T10:30:50.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 202014 11.90 MB/sec warmup 93 sec latency 8.503 ms 2022-09-17T10:30:51.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 203716 11.87 MB/sec warmup 94 sec latency 12.547 ms 2022-09-17T10:30:52.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 206264 11.90 MB/sec warmup 95 sec latency 15.625 ms 2022-09-17T10:30:53.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 207259 11.83 MB/sec warmup 96 sec latency 361.803 ms 2022-09-17T10:30:54.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 209803 11.85 MB/sec warmup 97 sec latency 13.521 ms 2022-09-17T10:30:55.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 212484 11.86 MB/sec warmup 98 sec latency 18.697 ms 2022-09-17T10:30:55.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:30:55.295 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:30:55.299 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:30:55.402 INFO:tasks.ceph.osd.2.smithi159.stderr:2022-09-17T10:30:55.399+0000 7ff47a94b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 85795) UID: 0 2022-09-17T10:30:55.404 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T10:30:55.399+0000 7ff583417700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 85795) UID: 0 2022-09-17T10:30:55.404 INFO:tasks.ceph.osd.11.smithi159.stderr:2022-09-17T10:30:55.399+0000 7f226e83e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 85795) UID: 0 2022-09-17T10:30:55.405 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:30:55.400+0000 7f3cadcf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 85795) UID: 0 2022-09-17T10:30:56.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 214040 11.82 MB/sec warmup 99 sec latency 29.282 ms 2022-09-17T10:30:57.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 216734 11.87 MB/sec warmup 100 sec latency 13.647 ms 2022-09-17T10:30:58.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 218719 11.82 MB/sec warmup 101 sec latency 87.530 ms 2022-09-17T10:30:59.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 220518 11.83 MB/sec warmup 102 sec latency 11.821 ms 2022-09-17T10:31:00.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 222946 11.84 MB/sec warmup 103 sec latency 28.570 ms 2022-09-17T10:31:01.029 INFO:tasks.workunit.client.0.smithi062.stdout: 1 224494 11.79 MB/sec warmup 104 sec latency 11.301 ms 2022-09-17T10:31:02.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 227208 11.84 MB/sec warmup 105 sec latency 12.607 ms 2022-09-17T10:31:03.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 228751 11.79 MB/sec warmup 106 sec latency 18.748 ms 2022-09-17T10:31:04.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 231026 11.81 MB/sec warmup 107 sec latency 12.078 ms 2022-09-17T10:31:05.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 232809 11.76 MB/sec warmup 108 sec latency 113.365 ms 2022-09-17T10:31:06.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 234581 11.77 MB/sec warmup 109 sec latency 34.893 ms 2022-09-17T10:31:07.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 236565 11.73 MB/sec warmup 110 sec latency 134.358 ms 2022-09-17T10:31:08.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 238305 11.73 MB/sec warmup 111 sec latency 9.834 ms 2022-09-17T10:31:09.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 240627 11.74 MB/sec warmup 112 sec latency 84.109 ms 2022-09-17T10:31:10.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 241231 11.68 MB/sec warmup 113 sec latency 234.774 ms 2022-09-17T10:31:11.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 241636 11.59 MB/sec warmup 114 sec latency 467.063 ms 2022-09-17T10:31:12.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 243675 11.55 MB/sec warmup 115 sec latency 49.560 ms 2022-09-17T10:31:13.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 245312 11.56 MB/sec warmup 116 sec latency 34.763 ms 2022-09-17T10:31:14.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 247687 11.56 MB/sec warmup 117 sec latency 49.128 ms 2022-09-17T10:31:15.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 249137 11.53 MB/sec warmup 118 sec latency 47.755 ms 2022-09-17T10:31:16.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 252033 11.57 MB/sec warmup 119 sec latency 10.607 ms 2022-09-17T10:31:18.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 256017 13.64 MB/sec execute 1 sec latency 24.007 ms 2022-09-17T10:31:19.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 258442 13.10 MB/sec execute 2 sec latency 63.140 ms 2022-09-17T10:31:20.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 259779 11.09 MB/sec execute 3 sec latency 103.093 ms 2022-09-17T10:31:21.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 262622 12.63 MB/sec execute 4 sec latency 10.161 ms 2022-09-17T10:31:22.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 264171 11.42 MB/sec execute 5 sec latency 16.835 ms 2022-09-17T10:31:23.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 266447 11.83 MB/sec execute 6 sec latency 15.434 ms 2022-09-17T10:31:24.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 268622 11.28 MB/sec execute 7 sec latency 10.003 ms 2022-09-17T10:31:25.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 270324 11.29 MB/sec execute 8 sec latency 14.887 ms 2022-09-17T10:31:26.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 272964 11.62 MB/sec execute 9 sec latency 13.461 ms 2022-09-17T10:31:27.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 274306 11.13 MB/sec execute 10 sec latency 21.298 ms 2022-09-17T10:31:28.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 276934 11.64 MB/sec execute 11 sec latency 12.164 ms 2022-09-17T10:31:29.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 279029 11.27 MB/sec execute 12 sec latency 9.055 ms 2022-09-17T10:31:30.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 280838 11.34 MB/sec execute 13 sec latency 18.310 ms 2022-09-17T10:31:31.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 282050 10.92 MB/sec execute 14 sec latency 226.507 ms 2022-09-17T10:31:32.030 INFO:tasks.workunit.client.0.smithi062.stdout: 1 284012 11.08 MB/sec execute 15 sec latency 295.207 ms 2022-09-17T10:31:33.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 285424 10.74 MB/sec execute 16 sec latency 44.012 ms 2022-09-17T10:31:34.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 287755 10.92 MB/sec execute 17 sec latency 15.559 ms 2022-09-17T10:31:35.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 290264 11.01 MB/sec execute 18 sec latency 15.871 ms 2022-09-17T10:31:36.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 291865 10.83 MB/sec execute 19 sec latency 15.638 ms 2022-09-17T10:31:37.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 294514 11.12 MB/sec execute 20 sec latency 109.410 ms 2022-09-17T10:31:38.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 296315 10.92 MB/sec execute 21 sec latency 8.073 ms 2022-09-17T10:31:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 298517 11.05 MB/sec execute 22 sec latency 9.802 ms 2022-09-17T10:31:40.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 301141 11.14 MB/sec execute 23 sec latency 10.910 ms 2022-09-17T10:31:41.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 302630 11.01 MB/sec execute 24 sec latency 12.017 ms 2022-09-17T10:31:42.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 305360 11.24 MB/sec execute 25 sec latency 8.514 ms 2022-09-17T10:31:43.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 307460 11.09 MB/sec execute 26 sec latency 54.471 ms 2022-09-17T10:31:44.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 309274 11.13 MB/sec execute 27 sec latency 12.496 ms 2022-09-17T10:31:45.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 311969 11.25 MB/sec execute 28 sec latency 9.962 ms 2022-09-17T10:31:46.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 313435 11.09 MB/sec execute 29 sec latency 8.276 ms 2022-09-17T10:31:47.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 316046 11.29 MB/sec execute 30 sec latency 9.739 ms 2022-09-17T10:31:48.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 318113 11.15 MB/sec execute 31 sec latency 21.712 ms 2022-09-17T10:31:49.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 319930 11.19 MB/sec execute 32 sec latency 14.727 ms 2022-09-17T10:31:50.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 322616 11.28 MB/sec execute 33 sec latency 12.626 ms 2022-09-17T10:31:51.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 324198 11.23 MB/sec execute 34 sec latency 16.466 ms 2022-09-17T10:31:52.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 326707 11.31 MB/sec execute 35 sec latency 11.302 ms 2022-09-17T10:31:53.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 328829 11.22 MB/sec execute 36 sec latency 10.261 ms 2022-09-17T10:31:54.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 330028 11.19 MB/sec execute 37 sec latency 345.120 ms 2022-09-17T10:31:55.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 331746 11.07 MB/sec execute 38 sec latency 10.677 ms 2022-09-17T10:31:56.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 333980 11.14 MB/sec execute 39 sec latency 9.182 ms 2022-09-17T10:31:57.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 336440 11.17 MB/sec execute 40 sec latency 15.881 ms 2022-09-17T10:31:58.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 337926 11.08 MB/sec execute 41 sec latency 29.736 ms 2022-09-17T10:31:59.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 340529 11.21 MB/sec execute 42 sec latency 79.138 ms 2022-09-17T10:32:00.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 342037 11.11 MB/sec execute 43 sec latency 12.765 ms 2022-09-17T10:32:01.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 344456 11.17 MB/sec execute 44 sec latency 11.701 ms 2022-09-17T10:32:02.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 346657 11.10 MB/sec execute 45 sec latency 56.272 ms 2022-09-17T10:32:03.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 348365 11.11 MB/sec execute 46 sec latency 10.706 ms 2022-09-17T10:32:04.031 INFO:tasks.workunit.client.0.smithi062.stdout: 1 351119 11.24 MB/sec execute 47 sec latency 14.861 ms 2022-09-17T10:32:05.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 352416 11.08 MB/sec execute 48 sec latency 17.434 ms 2022-09-17T10:32:06.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 355059 11.20 MB/sec execute 49 sec latency 11.626 ms 2022-09-17T10:32:07.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 355461 10.99 MB/sec execute 50 sec latency 296.250 ms 2022-09-17T10:32:08.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 356395 10.87 MB/sec execute 51 sec latency 344.021 ms 2022-09-17T10:32:09.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 358497 10.92 MB/sec execute 52 sec latency 97.150 ms 2022-09-17T10:32:10.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 360585 10.85 MB/sec execute 53 sec latency 40.809 ms 2022-09-17T10:32:11.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 362393 10.87 MB/sec execute 54 sec latency 11.307 ms 2022-09-17T10:32:12.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 365094 10.94 MB/sec execute 55 sec latency 13.926 ms 2022-09-17T10:32:13.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 366547 10.86 MB/sec execute 56 sec latency 15.472 ms 2022-09-17T10:32:14.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 369246 10.97 MB/sec execute 57 sec latency 16.308 ms 2022-09-17T10:32:15.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 371442 10.92 MB/sec execute 58 sec latency 9.975 ms 2022-09-17T10:32:16.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 372982 10.93 MB/sec execute 59 sec latency 119.445 ms 2022-09-17T10:32:17.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 375429 10.95 MB/sec execute 60 sec latency 12.864 ms 2022-09-17T10:32:18.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 376953 10.89 MB/sec execute 61 sec latency 11.018 ms 2022-09-17T10:32:19.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 379762 11.01 MB/sec execute 62 sec latency 11.033 ms 2022-09-17T10:32:20.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 381456 10.93 MB/sec execute 63 sec latency 9.911 ms 2022-09-17T10:32:21.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 383408 10.96 MB/sec execute 64 sec latency 103.224 ms 2022-09-17T10:32:22.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 385546 10.91 MB/sec execute 65 sec latency 11.690 ms 2022-09-17T10:32:23.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 387234 10.93 MB/sec execute 66 sec latency 35.700 ms 2022-09-17T10:32:24.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 389655 10.95 MB/sec execute 67 sec latency 10.628 ms 2022-09-17T10:32:25.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 391143 10.90 MB/sec execute 68 sec latency 23.293 ms 2022-09-17T10:32:26.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 393773 10.98 MB/sec execute 69 sec latency 89.525 ms 2022-09-17T10:32:27.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 394745 10.86 MB/sec execute 70 sec latency 142.396 ms 2022-09-17T10:32:28.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 396215 10.80 MB/sec execute 71 sec latency 226.059 ms 2022-09-17T10:32:29.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 397841 10.81 MB/sec execute 72 sec latency 35.339 ms 2022-09-17T10:32:30.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 400241 10.84 MB/sec execute 73 sec latency 10.808 ms 2022-09-17T10:32:30.626 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:30.623+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:31.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 401733 10.79 MB/sec execute 74 sec latency 15.335 ms 2022-09-17T10:32:31.671 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:31.669+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:32.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 404490 10.87 MB/sec execute 75 sec latency 11.197 ms 2022-09-17T10:32:32.700 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:32.698+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:33.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 405909 10.81 MB/sec execute 76 sec latency 22.398 ms 2022-09-17T10:32:33.697 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:33.678+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:34.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 408263 10.85 MB/sec execute 77 sec latency 59.385 ms 2022-09-17T10:32:34.705 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:34.702+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:35.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 410377 10.81 MB/sec execute 78 sec latency 12.493 ms 2022-09-17T10:32:35.711 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:35.710+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:36.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 412091 10.82 MB/sec execute 79 sec latency 9.931 ms 2022-09-17T10:32:36.704 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:36.702+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:37.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 414388 10.84 MB/sec execute 80 sec latency 103.119 ms 2022-09-17T10:32:37.738 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:37.736+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:38.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 415509 10.79 MB/sec execute 81 sec latency 185.224 ms 2022-09-17T10:32:38.726 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:38.724+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:39.032 INFO:tasks.workunit.client.0.smithi062.stdout: 1 417800 10.79 MB/sec execute 82 sec latency 17.326 ms 2022-09-17T10:32:39.742 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:39.740+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:40.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 419393 10.77 MB/sec execute 83 sec latency 12.094 ms 2022-09-17T10:32:40.758 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:40.755+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:41.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 422213 10.84 MB/sec execute 84 sec latency 16.156 ms 2022-09-17T10:32:41.782 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:41.776+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:42.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 423800 10.80 MB/sec execute 85 sec latency 15.683 ms 2022-09-17T10:32:42.747 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:42.745+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:43.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 425928 10.83 MB/sec execute 86 sec latency 87.635 ms 2022-09-17T10:32:43.706 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:43.703+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:44.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 428059 10.79 MB/sec execute 87 sec latency 13.846 ms 2022-09-17T10:32:44.749 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:44.746+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:45.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 429820 10.80 MB/sec execute 88 sec latency 12.725 ms 2022-09-17T10:32:45.760 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:45.757+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:46.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 432388 10.83 MB/sec execute 89 sec latency 13.710 ms 2022-09-17T10:32:46.743 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:46.740+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:47.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 433920 10.80 MB/sec execute 90 sec latency 8.609 ms 2022-09-17T10:32:47.738 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:47.735+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:48.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 436545 10.86 MB/sec execute 91 sec latency 46.376 ms 2022-09-17T10:32:48.753 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:48.750+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:49.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 438585 10.81 MB/sec execute 92 sec latency 10.524 ms 2022-09-17T10:32:49.755 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:49.748+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:50.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 440399 10.84 MB/sec execute 93 sec latency 29.439 ms 2022-09-17T10:32:50.772 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:50.769+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:51.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 442846 10.86 MB/sec execute 94 sec latency 14.879 ms 2022-09-17T10:32:51.806 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:51.804+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 444394 10.82 MB/sec execute 95 sec latency 12.392 ms 2022-09-17T10:32:52.772 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:52.769+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:53.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 447163 10.89 MB/sec execute 96 sec latency 19.986 ms 2022-09-17T10:32:53.739 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:53.737+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:54.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 448125 10.81 MB/sec execute 97 sec latency 138.579 ms 2022-09-17T10:32:54.697 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:54.694+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:55.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 450803 10.87 MB/sec execute 98 sec latency 11.744 ms 2022-09-17T10:32:55.747 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:55.744+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:56.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 452985 10.84 MB/sec execute 99 sec latency 10.859 ms 2022-09-17T10:32:56.725 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:56.717+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:57.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 454770 10.85 MB/sec execute 100 sec latency 13.987 ms 2022-09-17T10:32:57.672 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:57.669+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:58.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 457400 10.88 MB/sec execute 101 sec latency 37.774 ms 2022-09-17T10:32:58.674 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:58.670+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:32:59.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 458599 10.92 MB/sec execute 102 sec latency 74.776 ms 2022-09-17T10:32:59.700 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:32:59.697+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:00.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 460772 10.99 MB/sec execute 103 sec latency 117.329 ms 2022-09-17T10:33:00.737 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:00.734+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:01.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 462638 11.00 MB/sec execute 104 sec latency 16.571 ms 2022-09-17T10:33:01.781 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:01.778+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:02.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 465241 11.03 MB/sec execute 105 sec latency 72.206 ms 2022-09-17T10:33:02.813 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:02.809+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:03.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 466237 10.98 MB/sec execute 106 sec latency 234.865 ms 2022-09-17T10:33:03.813 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:03.810+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:04.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 466424 10.88 MB/sec execute 107 sec latency 536.779 ms 2022-09-17T10:33:04.814 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:04.811+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:05.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 469115 10.93 MB/sec execute 108 sec latency 54.658 ms 2022-09-17T10:33:05.819 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:05.816+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:06.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 470428 10.89 MB/sec execute 109 sec latency 40.768 ms 2022-09-17T10:33:06.828 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:06.825+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:07.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 472851 10.92 MB/sec execute 110 sec latency 13.761 ms 2022-09-17T10:33:07.786 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:07.783+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:08.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 474980 10.89 MB/sec execute 111 sec latency 15.127 ms 2022-09-17T10:33:08.753 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:08.750+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:09.033 INFO:tasks.workunit.client.0.smithi062.stdout: 1 476773 10.90 MB/sec execute 112 sec latency 9.930 ms 2022-09-17T10:33:09.746 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:09.743+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:10.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 479398 10.93 MB/sec execute 113 sec latency 14.372 ms 2022-09-17T10:33:10.766 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:10.763+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:11.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 480727 10.89 MB/sec execute 114 sec latency 14.884 ms 2022-09-17T10:33:11.776 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:11.774+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:12.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 483464 10.94 MB/sec execute 115 sec latency 9.749 ms 2022-09-17T10:33:12.761 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:12.758+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:13.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 485620 10.91 MB/sec execute 116 sec latency 27.504 ms 2022-09-17T10:33:13.749 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:13.746+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:14.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 487477 10.92 MB/sec execute 117 sec latency 11.835 ms 2022-09-17T10:33:14.776 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:14.773+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:15.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 490271 10.98 MB/sec execute 118 sec latency 15.426 ms 2022-09-17T10:33:15.736 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:15.733+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:16.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 491182 10.90 MB/sec execute 119 sec latency 170.489 ms 2022-09-17T10:33:16.689 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:16.686+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:17.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 494055 10.96 MB/sec execute 120 sec latency 11.662 ms 2022-09-17T10:33:17.734 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:17.731+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:18.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 495830 10.92 MB/sec execute 121 sec latency 19.107 ms 2022-09-17T10:33:18.747 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:18.744+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:19.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 497960 10.94 MB/sec execute 122 sec latency 17.366 ms 2022-09-17T10:33:19.773 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:19.771+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:20.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 500607 10.96 MB/sec execute 123 sec latency 9.139 ms 2022-09-17T10:33:20.800 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:20.797+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:21.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 502128 10.94 MB/sec execute 124 sec latency 8.650 ms 2022-09-17T10:33:21.761 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:21.758+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:22.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 504577 10.98 MB/sec execute 125 sec latency 113.588 ms 2022-09-17T10:33:22.766 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:22.763+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:22.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:33:22.965 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:33:22.968 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:33:23.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 505997 10.94 MB/sec execute 126 sec latency 52.232 ms 2022-09-17T10:33:23.101 INFO:tasks.ceph.osd.0.smithi062.stderr:2022-09-17T10:33:23.098+0000 7f90200c7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90725) UID: 0 2022-09-17T10:33:23.102 INFO:tasks.ceph.osd.3.smithi062.stderr:2022-09-17T10:33:23.098+0000 7fdaea491700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90725) UID: 0 2022-09-17T10:33:23.102 INFO:tasks.ceph.osd.9.smithi062.stderr:2022-09-17T10:33:23.098+0000 7f65b4ce1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90725) UID: 0 2022-09-17T10:33:23.103 INFO:tasks.ceph.osd.6.smithi062.stderr:2022-09-17T10:33:23.098+0000 7f28a2d46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90725) UID: 0 2022-09-17T10:33:23.135 INFO:tasks.ceph.osd.2.smithi159.stderr:2022-09-17T10:33:23.128+0000 7ff47a94b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86135) UID: 0 2022-09-17T10:33:23.136 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T10:33:23.128+0000 7ff583417700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86135) UID: 0 2022-09-17T10:33:23.137 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:23.128+0000 7f3cadcf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86135) UID: 0 2022-09-17T10:33:23.137 INFO:tasks.ceph.osd.11.smithi159.stderr:2022-09-17T10:33:23.129+0000 7f226e83e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86135) UID: 0 2022-09-17T10:33:23.776 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:23.771+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:24.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 507827 10.93 MB/sec execute 127 sec latency 173.281 ms 2022-09-17T10:33:24.738 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:24.735+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:25.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 508633 10.88 MB/sec execute 128 sec latency 328.252 ms 2022-09-17T10:33:25.777 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:25.774+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:26.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 511027 10.89 MB/sec execute 129 sec latency 33.446 ms 2022-09-17T10:33:26.827 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:26.824+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:27.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 512372 10.86 MB/sec execute 130 sec latency 31.160 ms 2022-09-17T10:33:27.866 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:27.863+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:28.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 515090 10.91 MB/sec execute 131 sec latency 11.107 ms 2022-09-17T10:33:28.823 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:28.820+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:29.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 516279 10.85 MB/sec execute 132 sec latency 12.730 ms 2022-09-17T10:33:29.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:29.860+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:30.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 518800 10.89 MB/sec execute 133 sec latency 16.646 ms 2022-09-17T10:33:30.840 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:30.837+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:31.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 520282 10.86 MB/sec execute 134 sec latency 14.920 ms 2022-09-17T10:33:31.798 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:31.795+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:32.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 522602 10.88 MB/sec execute 135 sec latency 14.365 ms 2022-09-17T10:33:32.815 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:32.812+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:33.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 524616 10.85 MB/sec execute 136 sec latency 17.886 ms 2022-09-17T10:33:33.778 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:33.775+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:34.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 526219 10.86 MB/sec execute 137 sec latency 53.872 ms 2022-09-17T10:33:34.737 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:34.734+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:35.036 INFO:tasks.workunit.client.0.smithi062.stdout: 1 528325 10.84 MB/sec execute 138 sec latency 52.537 ms 2022-09-17T10:33:35.788 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:35.782+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:36.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 529971 10.84 MB/sec execute 139 sec latency 63.553 ms 2022-09-17T10:33:36.821 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:36.818+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:37.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 532217 10.85 MB/sec execute 140 sec latency 18.286 ms 2022-09-17T10:33:37.811 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:37.808+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:38.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 533318 10.83 MB/sec execute 141 sec latency 223.250 ms 2022-09-17T10:33:38.802 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:38.799+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:39.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 535336 10.80 MB/sec execute 142 sec latency 40.880 ms 2022-09-17T10:33:39.764 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:39.761+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:40.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 536994 10.81 MB/sec execute 143 sec latency 45.257 ms 2022-09-17T10:33:40.807 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:40.804+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:41.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 539196 10.81 MB/sec execute 144 sec latency 11.998 ms 2022-09-17T10:33:41.795 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:41.792+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:42.034 INFO:tasks.workunit.client.0.smithi062.stdout: 1 540663 10.79 MB/sec execute 145 sec latency 15.054 ms 2022-09-17T10:33:42.824 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:42.820+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:43.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 542898 10.80 MB/sec execute 146 sec latency 23.127 ms 2022-09-17T10:33:43.817 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:43.814+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:44.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 544123 10.77 MB/sec execute 147 sec latency 112.579 ms 2022-09-17T10:33:44.862 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:44.858+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:45.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 546399 10.78 MB/sec execute 148 sec latency 16.203 ms 2022-09-17T10:33:45.812 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:45.809+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:46.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 547791 10.76 MB/sec execute 149 sec latency 23.087 ms 2022-09-17T10:33:46.855 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:46.852+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:47.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 550264 10.77 MB/sec execute 150 sec latency 14.991 ms 2022-09-17T10:33:47.890 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:47.887+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:48.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 551592 10.75 MB/sec execute 151 sec latency 14.354 ms 2022-09-17T10:33:48.862 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:48.859+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:49.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 554164 10.79 MB/sec execute 152 sec latency 94.769 ms 2022-09-17T10:33:49.897 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:49.894+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:50.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 555585 10.76 MB/sec execute 153 sec latency 12.188 ms 2022-09-17T10:33:50.854 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:50.851+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:51.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 558001 10.78 MB/sec execute 154 sec latency 39.939 ms 2022-09-17T10:33:51.893 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:51.890+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 560094 10.76 MB/sec execute 155 sec latency 12.155 ms 2022-09-17T10:33:52.894 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:52.891+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:53.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 561854 10.77 MB/sec execute 156 sec latency 10.936 ms 2022-09-17T10:33:53.870 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:53.867+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:54.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 564131 10.77 MB/sec execute 157 sec latency 59.241 ms 2022-09-17T10:33:54.835 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:54.832+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:55.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 565377 10.75 MB/sec execute 158 sec latency 102.638 ms 2022-09-17T10:33:55.840 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:55.838+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:56.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 567716 10.76 MB/sec execute 159 sec latency 10.984 ms 2022-09-17T10:33:56.859 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:56.856+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:57.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 569077 10.74 MB/sec execute 160 sec latency 54.605 ms 2022-09-17T10:33:57.823 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:57.820+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:58.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 571364 10.75 MB/sec execute 161 sec latency 14.890 ms 2022-09-17T10:33:58.862 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:58.859+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:33:59.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 572627 10.72 MB/sec execute 162 sec latency 52.375 ms 2022-09-17T10:33:59.862 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:33:59.857+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:00.036 INFO:tasks.workunit.client.0.smithi062.stdout: 1 573734 10.69 MB/sec execute 163 sec latency 135.176 ms 2022-09-17T10:34:00.855 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:00.852+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:01.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 574859 10.67 MB/sec execute 164 sec latency 461.794 ms 2022-09-17T10:34:01.807 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:01.804+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:02.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 576223 10.64 MB/sec execute 165 sec latency 32.302 ms 2022-09-17T10:34:02.797 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:02.794+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:03.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 578630 10.66 MB/sec execute 166 sec latency 33.475 ms 2022-09-17T10:34:03.826 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:03.823+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 579880 10.63 MB/sec execute 167 sec latency 48.644 ms 2022-09-17T10:34:04.863 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:04.860+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:05.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 582611 10.67 MB/sec execute 168 sec latency 13.178 ms 2022-09-17T10:34:05.849 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:05.846+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:06.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 583747 10.63 MB/sec execute 169 sec latency 87.381 ms 2022-09-17T10:34:06.858 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:06.855+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:07.040 INFO:tasks.workunit.client.0.smithi062.stdout: 1 586288 10.66 MB/sec execute 170 sec latency 49.671 ms 2022-09-17T10:34:07.901 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:07.897+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:08.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 587847 10.63 MB/sec execute 171 sec latency 10.094 ms 2022-09-17T10:34:08.867 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:08.864+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:09.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 589980 10.65 MB/sec execute 172 sec latency 64.872 ms 2022-09-17T10:34:09.842 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:09.839+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:10.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 592023 10.63 MB/sec execute 173 sec latency 25.432 ms 2022-09-17T10:34:10.889 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:10.886+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:11.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 593565 10.64 MB/sec execute 174 sec latency 106.881 ms 2022-09-17T10:34:11.861 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:11.858+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:12.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 595618 10.62 MB/sec execute 175 sec latency 13.828 ms 2022-09-17T10:34:12.901 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:12.898+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:13.036 INFO:tasks.workunit.client.0.smithi062.stdout: 1 597312 10.63 MB/sec execute 176 sec latency 13.146 ms 2022-09-17T10:34:13.887 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:13.885+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:14.036 INFO:tasks.workunit.client.0.smithi062.stdout: 1 599612 10.64 MB/sec execute 177 sec latency 50.089 ms 2022-09-17T10:34:14.905 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:14.902+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:15.036 INFO:tasks.workunit.client.0.smithi062.stdout: 1 601046 10.62 MB/sec execute 178 sec latency 11.491 ms 2022-09-17T10:34:15.922 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:15.918+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:16.035 INFO:tasks.workunit.client.0.smithi062.stdout: 1 603623 10.64 MB/sec execute 179 sec latency 12.817 ms 2022-09-17T10:34:16.884 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:16.881+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:17.036 INFO:tasks.workunit.client.0.smithi062.stdout: 1 604630 10.61 MB/sec execute 180 sec latency 100.784 ms 2022-09-17T10:34:17.907 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:17.904+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:18.036 INFO:tasks.workunit.client.0.smithi062.stdout: 1 607336 10.64 MB/sec execute 181 sec latency 12.800 ms 2022-09-17T10:34:18.898 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:18.895+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:19.036 INFO:tasks.workunit.client.0.smithi062.stdout: 1 608523 10.60 MB/sec execute 182 sec latency 14.386 ms 2022-09-17T10:34:19.874 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:19.871+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:20.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 611044 10.63 MB/sec execute 183 sec latency 18.743 ms 2022-09-17T10:34:20.896 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:20.893+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:21.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 611349 10.58 MB/sec execute 184 sec latency 348.847 ms 2022-09-17T10:34:21.941 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:21.938+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:22.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 612543 10.55 MB/sec execute 185 sec latency 191.734 ms 2022-09-17T10:34:22.892 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:22.889+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:23.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 614683 10.57 MB/sec execute 186 sec latency 35.842 ms 2022-09-17T10:34:23.859 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:23.856+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:24.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 616141 10.54 MB/sec execute 187 sec latency 37.395 ms 2022-09-17T10:34:24.818 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:24.815+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:25.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 618322 10.56 MB/sec execute 188 sec latency 12.572 ms 2022-09-17T10:34:25.805 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:25.802+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:26.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 620319 10.54 MB/sec execute 189 sec latency 19.731 ms 2022-09-17T10:34:26.848 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:26.845+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:27.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 621937 10.55 MB/sec execute 190 sec latency 23.150 ms 2022-09-17T10:34:27.867 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:27.865+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:28.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 623922 10.53 MB/sec execute 191 sec latency 91.559 ms 2022-09-17T10:34:28.896 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:28.892+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:29.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 625661 10.54 MB/sec execute 192 sec latency 13.983 ms 2022-09-17T10:34:29.912 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:29.909+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:30.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 627999 10.55 MB/sec execute 193 sec latency 15.439 ms 2022-09-17T10:34:30.959 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:30.956+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:31.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 629338 10.53 MB/sec execute 194 sec latency 16.601 ms 2022-09-17T10:34:31.980 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:31.976+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:32.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 631547 10.54 MB/sec execute 195 sec latency 82.277 ms 2022-09-17T10:34:32.937 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:32.934+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:33.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 632776 10.52 MB/sec execute 196 sec latency 95.241 ms 2022-09-17T10:34:33.903 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:33.900+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:34.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 635156 10.53 MB/sec execute 197 sec latency 14.750 ms 2022-09-17T10:34:34.910 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:34.907+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:35.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 636510 10.51 MB/sec execute 198 sec latency 16.380 ms 2022-09-17T10:34:35.886 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:35.884+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:36.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 639067 10.53 MB/sec execute 199 sec latency 15.313 ms 2022-09-17T10:34:36.907 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:36.904+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:37.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 640354 10.51 MB/sec execute 200 sec latency 12.347 ms 2022-09-17T10:34:37.877 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:37.873+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:38.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 642899 10.54 MB/sec execute 201 sec latency 15.856 ms 2022-09-17T10:34:38.876 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:38.873+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:39.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 643858 10.50 MB/sec execute 202 sec latency 105.872 ms 2022-09-17T10:34:39.830 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:39.827+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:40.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 646486 10.53 MB/sec execute 203 sec latency 18.141 ms 2022-09-17T10:34:40.819 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:40.816+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:41.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 647880 10.51 MB/sec execute 204 sec latency 17.892 ms 2022-09-17T10:34:41.779 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:41.776+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:42.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 650195 10.52 MB/sec execute 205 sec latency 11.448 ms 2022-09-17T10:34:42.738 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:42.735+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:43.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 652032 10.50 MB/sec execute 206 sec latency 14.582 ms 2022-09-17T10:34:43.719 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:43.716+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:44.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 653813 10.51 MB/sec execute 207 sec latency 48.200 ms 2022-09-17T10:34:44.754 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:44.753+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:45.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 655334 10.49 MB/sec execute 208 sec latency 87.654 ms 2022-09-17T10:34:45.786 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:45.784+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:46.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 657344 10.50 MB/sec execute 209 sec latency 26.738 ms 2022-09-17T10:34:46.782 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:46.780+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:47.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 659352 10.49 MB/sec execute 210 sec latency 13.322 ms 2022-09-17T10:34:47.754 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:47.752+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:48.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 660962 10.50 MB/sec execute 211 sec latency 15.334 ms 2022-09-17T10:34:48.795 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:48.793+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:49.046 INFO:tasks.workunit.client.0.smithi062.stdout: 1 662914 10.48 MB/sec execute 212 sec latency 93.720 ms 2022-09-17T10:34:49.755 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:49.753+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:50.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 664414 10.49 MB/sec execute 213 sec latency 85.345 ms 2022-09-17T10:34:50.791 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:50.789+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:51.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 666273 10.47 MB/sec execute 214 sec latency 15.765 ms 2022-09-17T10:34:51.751 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:51.749+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:52.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 668021 10.48 MB/sec execute 215 sec latency 12.651 ms 2022-09-17T10:34:52.759 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:52.758+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:53.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 670018 10.46 MB/sec execute 216 sec latency 15.737 ms 2022-09-17T10:34:53.742 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:53.740+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:54.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 671534 10.47 MB/sec execute 217 sec latency 80.469 ms 2022-09-17T10:34:54.760 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:54.758+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:55.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 672868 10.45 MB/sec execute 218 sec latency 73.163 ms 2022-09-17T10:34:55.767 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:55.765+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:56.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 674922 10.46 MB/sec execute 219 sec latency 70.340 ms 2022-09-17T10:34:56.773 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:56.771+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:57.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 676201 10.44 MB/sec execute 220 sec latency 41.487 ms 2022-09-17T10:34:57.798 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:57.796+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:58.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 678428 10.45 MB/sec execute 221 sec latency 26.265 ms 2022-09-17T10:34:58.817 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:58.815+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:34:59.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 679744 10.43 MB/sec execute 222 sec latency 19.739 ms 2022-09-17T10:34:59.825 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:34:59.821+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:00.047 INFO:tasks.workunit.client.0.smithi062.stdout: 1 682090 10.44 MB/sec execute 223 sec latency 17.339 ms 2022-09-17T10:35:00.782 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:00.779+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:01.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 682969 10.41 MB/sec execute 224 sec latency 103.671 ms 2022-09-17T10:35:01.767 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:01.765+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:02.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 683121 10.36 MB/sec execute 225 sec latency 322.428 ms 2022-09-17T10:35:02.766 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:02.764+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:03.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 685406 10.38 MB/sec execute 226 sec latency 48.561 ms 2022-09-17T10:35:03.790 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:03.788+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:04.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 686507 10.35 MB/sec execute 227 sec latency 58.495 ms 2022-09-17T10:35:04.767 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:04.765+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:05.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 689032 10.38 MB/sec execute 228 sec latency 51.174 ms 2022-09-17T10:35:05.807 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:05.805+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:06.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 690374 10.36 MB/sec execute 229 sec latency 16.113 ms 2022-09-17T10:35:06.760 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:06.758+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:07.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 692652 10.37 MB/sec execute 230 sec latency 56.440 ms 2022-09-17T10:35:07.806 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:07.804+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 22 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:08.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 693997 10.35 MB/sec execute 231 sec latency 18.776 ms 2022-09-17T10:35:08.804 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:08.802+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:09.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 696044 10.36 MB/sec execute 232 sec latency 196.036 ms 2022-09-17T10:35:09.820 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:09.818+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:10.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 697204 10.33 MB/sec execute 233 sec latency 20.404 ms 2022-09-17T10:35:10.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:10.863+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:11.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 699704 10.36 MB/sec execute 234 sec latency 15.265 ms 2022-09-17T10:35:11.838 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:11.836+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:12.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 700845 10.33 MB/sec execute 235 sec latency 67.913 ms 2022-09-17T10:35:12.821 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:12.819+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:13.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 703398 10.36 MB/sec execute 236 sec latency 41.919 ms 2022-09-17T10:35:13.781 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:13.779+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:14.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 705477 10.34 MB/sec execute 237 sec latency 13.553 ms 2022-09-17T10:35:14.794 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:14.793+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:15.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 707148 10.35 MB/sec execute 238 sec latency 20.234 ms 2022-09-17T10:35:15.784 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:15.782+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:16.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 709391 10.35 MB/sec execute 239 sec latency 57.557 ms 2022-09-17T10:35:16.790 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:16.788+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:17.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 710961 10.34 MB/sec execute 240 sec latency 17.170 ms 2022-09-17T10:35:17.770 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:17.768+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:18.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 713591 10.36 MB/sec execute 241 sec latency 21.391 ms 2022-09-17T10:35:18.723 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:18.721+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:19.049 INFO:tasks.workunit.client.0.smithi062.stdout: 1 715044 10.35 MB/sec execute 242 sec latency 12.467 ms 2022-09-17T10:35:19.740 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:19.738+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:20.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 717607 10.37 MB/sec execute 243 sec latency 11.241 ms 2022-09-17T10:35:20.771 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:20.769+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:21.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 719690 10.36 MB/sec execute 244 sec latency 14.270 ms 2022-09-17T10:35:21.763 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:21.761+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:22.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 720821 10.36 MB/sec execute 245 sec latency 174.047 ms 2022-09-17T10:35:22.714 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:22.712+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:23.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 721793 10.33 MB/sec execute 246 sec latency 177.617 ms 2022-09-17T10:35:23.692 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:23.690+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:24.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 724383 10.35 MB/sec execute 247 sec latency 32.747 ms 2022-09-17T10:35:24.742 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:24.740+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:25.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 725789 10.34 MB/sec execute 248 sec latency 14.819 ms 2022-09-17T10:35:25.789 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:25.787+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:26.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 728093 10.35 MB/sec execute 249 sec latency 95.204 ms 2022-09-17T10:35:26.831 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:26.829+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 9 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:27.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 729586 10.33 MB/sec execute 250 sec latency 13.720 ms 2022-09-17T10:35:27.796 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:27.794+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:28.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 731763 10.35 MB/sec execute 251 sec latency 17.906 ms 2022-09-17T10:35:28.804 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:28.802+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:29.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 732943 10.33 MB/sec execute 252 sec latency 88.391 ms 2022-09-17T10:35:29.802 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:29.800+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:30.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 735305 10.34 MB/sec execute 253 sec latency 11.326 ms 2022-09-17T10:35:30.814 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:30.812+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:31.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 736952 10.32 MB/sec execute 254 sec latency 53.968 ms 2022-09-17T10:35:31.803 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:31.801+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:32.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 738978 10.33 MB/sec execute 255 sec latency 15.693 ms 2022-09-17T10:35:32.773 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:32.771+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:33.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 741039 10.32 MB/sec execute 256 sec latency 16.362 ms 2022-09-17T10:35:33.808 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:33.807+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:34.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 742599 10.33 MB/sec execute 257 sec latency 94.685 ms 2022-09-17T10:35:34.767 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:34.765+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:35.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 744895 10.33 MB/sec execute 258 sec latency 11.909 ms 2022-09-17T10:35:35.782 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:35.780+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:36.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 746477 10.32 MB/sec execute 259 sec latency 14.744 ms 2022-09-17T10:35:36.739 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:36.737+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:37.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 749040 10.34 MB/sec execute 260 sec latency 19.078 ms 2022-09-17T10:35:37.787 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:37.785+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:38.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 750316 10.32 MB/sec execute 261 sec latency 12.003 ms 2022-09-17T10:35:38.754 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:38.751+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:39.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 752928 10.35 MB/sec execute 262 sec latency 12.462 ms 2022-09-17T10:35:39.800 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:39.798+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:40.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 754473 10.33 MB/sec execute 263 sec latency 20.942 ms 2022-09-17T10:35:40.792 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:40.790+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:41.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 756783 10.34 MB/sec execute 264 sec latency 12.596 ms 2022-09-17T10:35:41.770 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:41.768+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:42.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 759219 10.35 MB/sec execute 265 sec latency 14.102 ms 2022-09-17T10:35:42.728 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:42.725+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:43.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 760753 10.34 MB/sec execute 266 sec latency 10.899 ms 2022-09-17T10:35:43.771 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:43.769+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:44.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 763483 10.37 MB/sec execute 267 sec latency 12.460 ms 2022-09-17T10:35:44.779 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:44.777+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:45.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 764283 10.34 MB/sec execute 268 sec latency 201.472 ms 2022-09-17T10:35:45.793 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:45.789+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:46.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 766796 10.35 MB/sec execute 269 sec latency 61.801 ms 2022-09-17T10:35:46.767 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:46.765+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:47.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 768178 10.33 MB/sec execute 270 sec latency 10.730 ms 2022-09-17T10:35:47.757 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:47.755+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:48.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 770728 10.36 MB/sec execute 271 sec latency 14.944 ms 2022-09-17T10:35:48.764 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:48.762+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:49.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 772158 10.34 MB/sec execute 272 sec latency 11.535 ms 2022-09-17T10:35:49.781 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:49.779+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:50.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 774300 10.35 MB/sec execute 273 sec latency 16.114 ms 2022-09-17T10:35:50.759 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:50.757+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:51.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 775307 10.32 MB/sec execute 274 sec latency 94.574 ms 2022-09-17T10:35:51.763 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:51.760+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:52.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 777831 10.35 MB/sec execute 275 sec latency 17.519 ms 2022-09-17T10:35:52.719 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:52.717+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:53.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 779354 10.33 MB/sec execute 276 sec latency 17.999 ms 2022-09-17T10:35:53.757 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:53.755+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:54.050 INFO:tasks.workunit.client.0.smithi062.stdout: 1 781523 10.34 MB/sec execute 277 sec latency 13.149 ms 2022-09-17T10:35:54.805 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:54.803+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:55.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 783593 10.33 MB/sec execute 278 sec latency 20.007 ms 2022-09-17T10:35:55.766 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:55.764+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:56.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 785190 10.34 MB/sec execute 279 sec latency 89.681 ms 2022-09-17T10:35:56.816 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:56.813+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:57.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 787253 10.33 MB/sec execute 280 sec latency 18.522 ms 2022-09-17T10:35:57.844 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:57.842+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:58.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 787950 10.31 MB/sec execute 281 sec latency 335.407 ms 2022-09-17T10:35:58.880 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:58.879+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:35:59.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 788911 10.30 MB/sec execute 282 sec latency 421.089 ms 2022-09-17T10:35:59.922 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:35:59.920+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:00.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 791014 10.30 MB/sec execute 283 sec latency 46.772 ms 2022-09-17T10:36:00.873 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:00.871+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:01.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 792517 10.29 MB/sec execute 284 sec latency 14.764 ms 2022-09-17T10:36:01.882 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:01.880+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:02.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 794958 10.30 MB/sec execute 285 sec latency 19.423 ms 2022-09-17T10:36:02.924 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:02.922+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:03.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 796065 10.29 MB/sec execute 286 sec latency 66.261 ms 2022-09-17T10:36:03.940 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:03.937+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:04.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 798542 10.29 MB/sec execute 287 sec latency 15.530 ms 2022-09-17T10:36:04.970 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:04.968+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:05.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 799806 10.28 MB/sec execute 288 sec latency 12.178 ms 2022-09-17T10:36:05.933 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:05.931+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:06.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 802361 10.30 MB/sec execute 289 sec latency 76.066 ms 2022-09-17T10:36:06.957 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:06.955+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:07.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 803224 10.28 MB/sec execute 290 sec latency 141.542 ms 2022-09-17T10:36:07.917 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:07.915+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:08.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 806026 10.30 MB/sec execute 291 sec latency 9.721 ms 2022-09-17T10:36:08.876 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:08.875+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:09.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 807442 10.29 MB/sec execute 292 sec latency 78.731 ms 2022-09-17T10:36:09.863 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:09.862+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:10.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 809881 10.30 MB/sec execute 293 sec latency 10.171 ms 2022-09-17T10:36:10.838 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:10.836+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:11.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 811957 10.29 MB/sec execute 294 sec latency 26.925 ms 2022-09-17T10:36:11.871 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:11.869+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:12.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 813766 10.30 MB/sec execute 295 sec latency 10.483 ms 2022-09-17T10:36:12.911 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:12.909+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:13.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 816042 10.30 MB/sec execute 296 sec latency 89.682 ms 2022-09-17T10:36:13.937 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:13.935+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:14.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 817506 10.29 MB/sec execute 297 sec latency 12.682 ms 2022-09-17T10:36:14.913 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:14.911+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:15.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 820209 10.31 MB/sec execute 298 sec latency 13.305 ms 2022-09-17T10:36:15.892 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:15.890+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:16.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 821607 10.30 MB/sec execute 299 sec latency 19.910 ms 2022-09-17T10:36:16.899 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:16.897+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:17.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 823988 10.31 MB/sec execute 300 sec latency 11.117 ms 2022-09-17T10:36:17.850 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:17.848+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:18.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 824810 10.29 MB/sec execute 301 sec latency 102.482 ms 2022-09-17T10:36:18.879 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:18.877+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:19.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 826705 10.29 MB/sec execute 302 sec latency 187.311 ms 2022-09-17T10:36:19.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:19.863+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:20.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 828018 10.28 MB/sec execute 303 sec latency 26.693 ms 2022-09-17T10:36:20.905 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:20.903+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:21.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 830415 10.28 MB/sec execute 304 sec latency 33.670 ms 2022-09-17T10:36:21.935 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:21.933+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:22.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 831689 10.27 MB/sec execute 305 sec latency 14.809 ms 2022-09-17T10:36:22.979 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:22.977+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:23.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 833985 10.28 MB/sec execute 306 sec latency 112.386 ms 2022-09-17T10:36:23.960 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:23.958+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:24.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 835109 10.27 MB/sec execute 307 sec latency 86.590 ms 2022-09-17T10:36:24.920 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:24.917+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:25.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 837544 10.28 MB/sec execute 308 sec latency 11.110 ms 2022-09-17T10:36:25.940 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:25.938+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:26.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 838790 10.26 MB/sec execute 309 sec latency 14.948 ms 2022-09-17T10:36:26.934 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:26.932+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:27.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 841281 10.27 MB/sec execute 310 sec latency 10.457 ms 2022-09-17T10:36:27.950 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:27.948+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:28.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 842427 10.26 MB/sec execute 311 sec latency 37.361 ms 2022-09-17T10:36:28.990 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:28.987+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:29.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 845128 10.28 MB/sec execute 312 sec latency 11.085 ms 2022-09-17T10:36:29.998 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:29.996+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:30.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 846156 10.26 MB/sec execute 313 sec latency 95.984 ms 2022-09-17T10:36:30.995 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:30.993+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:31.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 848683 10.28 MB/sec execute 314 sec latency 11.103 ms 2022-09-17T10:36:32.041 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:32.039+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:32.051 INFO:tasks.workunit.client.0.smithi062.stdout: 1 850040 10.26 MB/sec execute 315 sec latency 10.696 ms 2022-09-17T10:36:33.032 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:33.030+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:33.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 852380 10.28 MB/sec execute 316 sec latency 13.043 ms 2022-09-17T10:36:33.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:36:33.572 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:36:33.576 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:36:33.631 INFO:tasks.ceph.osd.0.smithi062.stderr:2022-09-17T10:36:33.628+0000 7f90200c7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90816) UID: 0 2022-09-17T10:36:33.632 INFO:tasks.ceph.osd.3.smithi062.stderr:2022-09-17T10:36:33.628+0000 7fdaea491700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90816) UID: 0 2022-09-17T10:36:33.632 INFO:tasks.ceph.osd.9.smithi062.stderr:2022-09-17T10:36:33.628+0000 7f65b4ce1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90816) UID: 0 2022-09-17T10:36:33.633 INFO:tasks.ceph.osd.6.smithi062.stderr:2022-09-17T10:36:33.628+0000 7f28a2d46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90816) UID: 0 2022-09-17T10:36:33.636 INFO:tasks.ceph.mds.c.smithi159.stderr:2022-09-17T10:36:33.633+0000 7faa6c70b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 86391) UID: 0 2022-09-17T10:36:33.637 INFO:tasks.ceph.mds.i.smithi159.stderr:2022-09-17T10:36:33.633+0000 7f353b18a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 86391) UID: 0 2022-09-17T10:36:33.638 INFO:tasks.ceph.mds.l.smithi159.stderr:2022-09-17T10:36:33.634+0000 7fe761d36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 86391) UID: 0 2022-09-17T10:36:33.639 INFO:tasks.ceph.mds.f.smithi159.stderr:2022-09-17T10:36:33.633+0000 7f9d5e235700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 86391) UID: 0 2022-09-17T10:36:33.997 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:33.995+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:34.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 853887 10.26 MB/sec execute 317 sec latency 15.297 ms 2022-09-17T10:36:34.989 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:34.987+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:35.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 855865 10.27 MB/sec execute 318 sec latency 92.913 ms 2022-09-17T10:36:35.979 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:35.977+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:36.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 857357 10.26 MB/sec execute 319 sec latency 15.003 ms 2022-09-17T10:36:36.985 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:36.983+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:37.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 859593 10.27 MB/sec execute 320 sec latency 12.448 ms 2022-09-17T10:36:37.951 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:37.949+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:38.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 861644 10.26 MB/sec execute 321 sec latency 12.133 ms 2022-09-17T10:36:38.916 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:38.914+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:39.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 863319 10.26 MB/sec execute 322 sec latency 14.735 ms 2022-09-17T10:36:39.885 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:39.883+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:40.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 865326 10.26 MB/sec execute 323 sec latency 65.306 ms 2022-09-17T10:36:40.919 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:40.917+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:41.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 867009 10.26 MB/sec execute 324 sec latency 14.126 ms 2022-09-17T10:36:41.957 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:41.954+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:42.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 869480 10.27 MB/sec execute 325 sec latency 20.586 ms 2022-09-17T10:36:42.942 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:42.940+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:43.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 870703 10.26 MB/sec execute 326 sec latency 20.383 ms 2022-09-17T10:36:43.942 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:43.940+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:44.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 873211 10.27 MB/sec execute 327 sec latency 17.461 ms 2022-09-17T10:36:44.915 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:44.913+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:45.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 874377 10.25 MB/sec execute 328 sec latency 13.289 ms 2022-09-17T10:36:45.942 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:45.940+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:46.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 876991 10.27 MB/sec execute 329 sec latency 13.511 ms 2022-09-17T10:36:46.979 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:46.977+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:47.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 878166 10.25 MB/sec execute 330 sec latency 15.859 ms 2022-09-17T10:36:47.934 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:47.932+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:48.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 880695 10.27 MB/sec execute 331 sec latency 25.544 ms 2022-09-17T10:36:48.945 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:48.943+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:49.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 882116 10.26 MB/sec execute 332 sec latency 28.793 ms 2022-09-17T10:36:49.912 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:49.910+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:50.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 884339 10.27 MB/sec execute 333 sec latency 14.931 ms 2022-09-17T10:36:50.883 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:50.881+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:51.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 885932 10.25 MB/sec execute 334 sec latency 26.545 ms 2022-09-17T10:36:51.877 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:51.875+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:52.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 887635 10.26 MB/sec execute 335 sec latency 223.846 ms 2022-09-17T10:36:52.892 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:52.890+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:53.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 888635 10.24 MB/sec execute 336 sec latency 50.596 ms 2022-09-17T10:36:53.863 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:53.860+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:54.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 890837 10.25 MB/sec execute 337 sec latency 141.703 ms 2022-09-17T10:36:54.845 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:54.843+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:55.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 891983 10.23 MB/sec execute 338 sec latency 20.545 ms 2022-09-17T10:36:55.832 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:55.829+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:56.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 894318 10.24 MB/sec execute 339 sec latency 20.511 ms 2022-09-17T10:36:56.829 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:56.827+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:57.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 895398 10.23 MB/sec execute 340 sec latency 43.303 ms 2022-09-17T10:36:57.791 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:57.789+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:58.052 INFO:tasks.workunit.client.0.smithi062.stdout: 1 897655 10.23 MB/sec execute 341 sec latency 12.800 ms 2022-09-17T10:36:58.741 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:58.739+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:36:59.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 897890 10.20 MB/sec execute 342 sec latency 480.296 ms 2022-09-17T10:36:59.749 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:36:59.747+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:00.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 898411 10.19 MB/sec execute 343 sec latency 430.021 ms 2022-09-17T10:37:00.708 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:00.706+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:01.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 898990 10.16 MB/sec execute 344 sec latency 84.329 ms 2022-09-17T10:37:01.740 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:01.738+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:02.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 899431 10.14 MB/sec execute 345 sec latency 374.403 ms 2022-09-17T10:37:02.700 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:02.698+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:03.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 901394 10.14 MB/sec execute 346 sec latency 66.140 ms 2022-09-17T10:37:03.655 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:03.653+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:04.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 902179 10.13 MB/sec execute 347 sec latency 111.217 ms 2022-09-17T10:37:04.662 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:04.659+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:05.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 903278 10.12 MB/sec execute 348 sec latency 98.073 ms 2022-09-17T10:37:05.663 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:05.661+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:06.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 905519 10.13 MB/sec execute 349 sec latency 19.937 ms 2022-09-17T10:37:06.621 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:06.619+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:07.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 906700 10.11 MB/sec execute 350 sec latency 14.525 ms 2022-09-17T10:37:07.614 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:07.612+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:08.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 908968 10.12 MB/sec execute 351 sec latency 20.356 ms 2022-09-17T10:37:08.636 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:08.634+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:09.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 909947 10.10 MB/sec execute 352 sec latency 44.506 ms 2022-09-17T10:37:09.610 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:09.608+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:10.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 912374 10.12 MB/sec execute 353 sec latency 17.156 ms 2022-09-17T10:37:10.571 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:10.569+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:11.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 913449 10.10 MB/sec execute 354 sec latency 15.828 ms 2022-09-17T10:37:11.612 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:11.610+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:12.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 915891 10.11 MB/sec execute 355 sec latency 16.021 ms 2022-09-17T10:37:12.633 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:12.631+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:13.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 916759 10.10 MB/sec execute 356 sec latency 66.953 ms 2022-09-17T10:37:13.618 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:13.616+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:14.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 917932 10.13 MB/sec execute 357 sec latency 199.847 ms 2022-09-17T10:37:14.606 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:14.604+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:15.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 919703 10.13 MB/sec execute 358 sec latency 161.146 ms 2022-09-17T10:37:15.627 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:15.625+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:16.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 921131 10.12 MB/sec execute 359 sec latency 14.406 ms 2022-09-17T10:37:16.620 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:16.618+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:17.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 923795 10.14 MB/sec execute 360 sec latency 13.672 ms 2022-09-17T10:37:17.587 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:17.585+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:18.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 924782 10.12 MB/sec execute 361 sec latency 74.615 ms 2022-09-17T10:37:18.578 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:18.576+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:19.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 927138 10.13 MB/sec execute 362 sec latency 65.454 ms 2022-09-17T10:37:19.621 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:19.620+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:20.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 928405 10.12 MB/sec execute 363 sec latency 16.366 ms 2022-09-17T10:37:20.591 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:20.589+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:21.053 INFO:tasks.workunit.client.0.smithi062.stdout: 1 930963 10.13 MB/sec execute 364 sec latency 13.646 ms 2022-09-17T10:37:21.593 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:21.591+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:22.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 931952 10.11 MB/sec execute 365 sec latency 23.846 ms 2022-09-17T10:37:22.580 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:22.578+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:23.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 934275 10.12 MB/sec execute 366 sec latency 62.956 ms 2022-09-17T10:37:23.602 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:23.600+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:24.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 935241 10.11 MB/sec execute 367 sec latency 81.544 ms 2022-09-17T10:37:24.607 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:24.605+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:25.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 937677 10.11 MB/sec execute 368 sec latency 13.714 ms 2022-09-17T10:37:25.618 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:25.616+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:26.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 938764 10.10 MB/sec execute 369 sec latency 90.509 ms 2022-09-17T10:37:26.652 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:26.650+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:27.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 940993 10.11 MB/sec execute 370 sec latency 14.184 ms 2022-09-17T10:37:27.624 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:27.622+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:28.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 942182 10.10 MB/sec execute 371 sec latency 81.540 ms 2022-09-17T10:37:28.620 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:28.618+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:29.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 944170 10.09 MB/sec execute 372 sec latency 18.582 ms 2022-09-17T10:37:29.671 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:29.668+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:30.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 945769 10.10 MB/sec execute 373 sec latency 13.582 ms 2022-09-17T10:37:30.626 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:30.624+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:31.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 947707 10.09 MB/sec execute 374 sec latency 28.306 ms 2022-09-17T10:37:31.627 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:31.625+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:32.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 949250 10.09 MB/sec execute 375 sec latency 13.703 ms 2022-09-17T10:37:32.622 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:32.620+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:33.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 951211 10.09 MB/sec execute 376 sec latency 17.119 ms 2022-09-17T10:37:33.651 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:33.649+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:34.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 952753 10.09 MB/sec execute 377 sec latency 20.566 ms 2022-09-17T10:37:34.675 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:34.671+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:35.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 953455 10.07 MB/sec execute 378 sec latency 182.528 ms 2022-09-17T10:37:35.627 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:35.625+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:36.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 955381 10.07 MB/sec execute 379 sec latency 261.887 ms 2022-09-17T10:37:36.588 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:36.586+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:37.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 956466 10.06 MB/sec execute 380 sec latency 33.790 ms 2022-09-17T10:37:37.635 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:37.633+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:38.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 958667 10.07 MB/sec execute 381 sec latency 30.624 ms 2022-09-17T10:37:38.603 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:38.601+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:39.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 960030 10.06 MB/sec execute 382 sec latency 12.046 ms 2022-09-17T10:37:39.596 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:39.594+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:40.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 962200 10.06 MB/sec execute 383 sec latency 51.818 ms 2022-09-17T10:37:40.550 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:40.548+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:41.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 963409 10.06 MB/sec execute 384 sec latency 57.926 ms 2022-09-17T10:37:41.534 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:41.532+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:42.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 965272 10.05 MB/sec execute 385 sec latency 17.112 ms 2022-09-17T10:37:42.549 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:42.545+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:43.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 966821 10.05 MB/sec execute 386 sec latency 11.875 ms 2022-09-17T10:37:43.535 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:43.533+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:44.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 968470 10.04 MB/sec execute 387 sec latency 138.511 ms 2022-09-17T10:37:44.496 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:44.494+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:45.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 970246 10.05 MB/sec execute 388 sec latency 23.914 ms 2022-09-17T10:37:45.504 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:45.502+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:46.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 971443 10.04 MB/sec execute 389 sec latency 84.666 ms 2022-09-17T10:37:46.470 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:46.468+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:47.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 973700 10.05 MB/sec execute 390 sec latency 21.530 ms 2022-09-17T10:37:47.481 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:47.479+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:48.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 975108 10.04 MB/sec execute 391 sec latency 12.414 ms 2022-09-17T10:37:48.442 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:48.440+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:49.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 977274 10.04 MB/sec execute 392 sec latency 22.463 ms 2022-09-17T10:37:49.477 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:49.475+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:50.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 978712 10.03 MB/sec execute 393 sec latency 13.230 ms 2022-09-17T10:37:50.457 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:50.455+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:51.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 980830 10.04 MB/sec execute 394 sec latency 21.199 ms 2022-09-17T10:37:51.454 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:51.452+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:52.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 981982 10.03 MB/sec execute 395 sec latency 92.639 ms 2022-09-17T10:37:52.474 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:52.472+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:53.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 984238 10.04 MB/sec execute 396 sec latency 43.752 ms 2022-09-17T10:37:53.434 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:53.432+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:54.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 985560 10.03 MB/sec execute 397 sec latency 16.217 ms 2022-09-17T10:37:54.401 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:54.399+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:55.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 987904 10.04 MB/sec execute 398 sec latency 30.662 ms 2022-09-17T10:37:55.407 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:55.405+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:56.054 INFO:tasks.workunit.client.0.smithi062.stdout: 1 988834 10.02 MB/sec execute 399 sec latency 73.673 ms 2022-09-17T10:37:56.365 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:56.361+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:57.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 991374 10.03 MB/sec execute 400 sec latency 29.283 ms 2022-09-17T10:37:57.400 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:57.398+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:58.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 992291 10.02 MB/sec execute 401 sec latency 98.142 ms 2022-09-17T10:37:58.391 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:58.389+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:37:59.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 994848 10.03 MB/sec execute 402 sec latency 19.246 ms 2022-09-17T10:37:59.347 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:37:59.345+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:00.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 995910 10.01 MB/sec execute 403 sec latency 58.805 ms 2022-09-17T10:38:00.353 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:00.351+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:01.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 998295 10.03 MB/sec execute 404 sec latency 88.294 ms 2022-09-17T10:38:01.308 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:01.306+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:02.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 999247 10.01 MB/sec execute 405 sec latency 60.851 ms 2022-09-17T10:38:02.326 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:02.323+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:03.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1001617 10.02 MB/sec execute 406 sec latency 78.978 ms 2022-09-17T10:38:03.290 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:03.288+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:04.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1002777 10.01 MB/sec execute 407 sec latency 25.162 ms 2022-09-17T10:38:04.284 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:04.282+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:05.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1005378 10.02 MB/sec execute 408 sec latency 24.201 ms 2022-09-17T10:38:05.272 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:05.270+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:06.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1005698 10.00 MB/sec execute 409 sec latency 343.121 ms 2022-09-17T10:38:06.227 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:06.225+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:07.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1006646 9.98 MB/sec execute 410 sec latency 198.330 ms 2022-09-17T10:38:07.225 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:07.223+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:08.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1009064 10.00 MB/sec execute 411 sec latency 36.165 ms 2022-09-17T10:38:08.221 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:08.220+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:09.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1010026 9.98 MB/sec execute 412 sec latency 79.066 ms 2022-09-17T10:38:09.268 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:09.266+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:10.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1012635 9.99 MB/sec execute 413 sec latency 15.051 ms 2022-09-17T10:38:10.230 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:10.228+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:11.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1013725 9.98 MB/sec execute 414 sec latency 47.178 ms 2022-09-17T10:38:11.260 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:11.258+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:12.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1016273 9.99 MB/sec execute 415 sec latency 28.699 ms 2022-09-17T10:38:12.264 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:12.262+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:13.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1017537 9.98 MB/sec execute 416 sec latency 37.056 ms 2022-09-17T10:38:13.223 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:13.221+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:14.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1019856 9.99 MB/sec execute 417 sec latency 16.754 ms 2022-09-17T10:38:14.259 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:14.257+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:15.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1021257 9.98 MB/sec execute 418 sec latency 46.864 ms 2022-09-17T10:38:15.231 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:15.229+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:16.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1023375 9.99 MB/sec execute 419 sec latency 126.080 ms 2022-09-17T10:38:16.202 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:16.200+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:17.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1024657 9.98 MB/sec execute 420 sec latency 21.883 ms 2022-09-17T10:38:17.243 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:17.240+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:18.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1026941 9.99 MB/sec execute 421 sec latency 16.767 ms 2022-09-17T10:38:18.193 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:18.191+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:19.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1028328 9.98 MB/sec execute 422 sec latency 57.654 ms 2022-09-17T10:38:19.176 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:19.173+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:20.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1029707 9.97 MB/sec execute 423 sec latency 210.795 ms 2022-09-17T10:38:20.152 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:20.150+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:21.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1031037 9.96 MB/sec execute 424 sec latency 20.518 ms 2022-09-17T10:38:21.199 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:21.197+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:22.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1033580 9.97 MB/sec execute 425 sec latency 21.873 ms 2022-09-17T10:38:22.203 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:22.202+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:23.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1034587 9.96 MB/sec execute 426 sec latency 79.701 ms 2022-09-17T10:38:23.216 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:23.215+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:24.055 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1037128 9.97 MB/sec execute 427 sec latency 16.772 ms 2022-09-17T10:38:24.177 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:24.175+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:25.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1038124 9.96 MB/sec execute 428 sec latency 79.767 ms 2022-09-17T10:38:25.144 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:25.142+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:26.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1039902 9.96 MB/sec execute 429 sec latency 130.476 ms 2022-09-17T10:38:26.101 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:26.099+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:27.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1041194 9.96 MB/sec execute 430 sec latency 175.777 ms 2022-09-17T10:38:27.057 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:27.054+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:28.029 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:28.027+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:28.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1042638 9.95 MB/sec execute 431 sec latency 48.328 ms 2022-09-17T10:38:28.988 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:28.986+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:29.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1044758 9.96 MB/sec execute 432 sec latency 15.809 ms 2022-09-17T10:38:29.942 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:29.940+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:30.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1046107 9.95 MB/sec execute 433 sec latency 55.783 ms 2022-09-17T10:38:30.948 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:30.946+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:31.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1048206 9.95 MB/sec execute 434 sec latency 74.317 ms 2022-09-17T10:38:31.975 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:31.973+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:32.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1049197 9.94 MB/sec execute 435 sec latency 90.447 ms 2022-09-17T10:38:32.935 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:32.933+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:33.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1051606 9.95 MB/sec execute 436 sec latency 63.060 ms 2022-09-17T10:38:33.904 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:33.902+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:34.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1051847 9.93 MB/sec execute 437 sec latency 698.261 ms 2022-09-17T10:38:34.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:34.863+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:35.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1053148 9.92 MB/sec execute 438 sec latency 112.277 ms 2022-09-17T10:38:35.880 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:35.878+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:36.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1055285 9.93 MB/sec execute 439 sec latency 47.122 ms 2022-09-17T10:38:36.895 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:36.893+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:37.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1056465 9.92 MB/sec execute 440 sec latency 31.086 ms 2022-09-17T10:38:37.881 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:37.879+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:38.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1058707 9.92 MB/sec execute 441 sec latency 42.274 ms 2022-09-17T10:38:38.893 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:38.891+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:39.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1059589 9.91 MB/sec execute 442 sec latency 83.332 ms 2022-09-17T10:38:39.893 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:39.890+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:40.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1061959 9.91 MB/sec execute 443 sec latency 22.400 ms 2022-09-17T10:38:40.856 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:40.853+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:41.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1063031 9.90 MB/sec execute 444 sec latency 48.290 ms 2022-09-17T10:38:41.813 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:41.810+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:42.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1064597 9.90 MB/sec execute 445 sec latency 171.776 ms 2022-09-17T10:38:42.810 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:42.807+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:43.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1066123 9.90 MB/sec execute 446 sec latency 23.187 ms 2022-09-17T10:38:43.846 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:43.843+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:44.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1068035 9.89 MB/sec execute 447 sec latency 22.959 ms 2022-09-17T10:38:44.884 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:44.881+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:45.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1069611 9.90 MB/sec execute 448 sec latency 14.487 ms 2022-09-17T10:38:45.908 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:45.905+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:46.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1070459 9.88 MB/sec execute 449 sec latency 141.618 ms 2022-09-17T10:38:46.861 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:46.858+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:47.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1072530 9.89 MB/sec execute 450 sec latency 72.540 ms 2022-09-17T10:38:47.861 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:47.858+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:48.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1073522 9.88 MB/sec execute 451 sec latency 92.299 ms 2022-09-17T10:38:48.900 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:48.897+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:49.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1075753 9.88 MB/sec execute 452 sec latency 36.712 ms 2022-09-17T10:38:49.942 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:49.939+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:50.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1077062 9.88 MB/sec execute 453 sec latency 27.535 ms 2022-09-17T10:38:50.920 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:50.917+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:51.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1079316 9.88 MB/sec execute 454 sec latency 13.130 ms 2022-09-17T10:38:51.957 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:51.954+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:52.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1080550 9.87 MB/sec execute 455 sec latency 75.194 ms 2022-09-17T10:38:52.950 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:52.947+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:53.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1082452 9.87 MB/sec execute 456 sec latency 42.563 ms 2022-09-17T10:38:53.922 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:53.919+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:54.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1083967 9.87 MB/sec execute 457 sec latency 29.793 ms 2022-09-17T10:38:54.937 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:54.934+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:55.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1085861 9.87 MB/sec execute 458 sec latency 53.352 ms 2022-09-17T10:38:55.928 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:55.925+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:56.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1087427 9.87 MB/sec execute 459 sec latency 16.738 ms 2022-09-17T10:38:56.904 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:56.900+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:57.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1088876 9.86 MB/sec execute 460 sec latency 95.757 ms 2022-09-17T10:38:57.892 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:57.889+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:58.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1090767 9.87 MB/sec execute 461 sec latency 16.112 ms 2022-09-17T10:38:58.871 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:58.868+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:38:59.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1091603 9.85 MB/sec execute 462 sec latency 172.219 ms 2022-09-17T10:38:59.851 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:38:59.848+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:00.056 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1093845 9.86 MB/sec execute 463 sec latency 43.011 ms 2022-09-17T10:39:00.886 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:00.875+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:01.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1094856 9.85 MB/sec execute 464 sec latency 46.387 ms 2022-09-17T10:39:01.900 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:01.897+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:02.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1096117 9.84 MB/sec execute 465 sec latency 197.870 ms 2022-09-17T10:39:02.893 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:02.890+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:03.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1096819 9.83 MB/sec execute 466 sec latency 498.307 ms 2022-09-17T10:39:03.900 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:03.897+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:04.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1098048 9.82 MB/sec execute 467 sec latency 51.212 ms 2022-09-17T10:39:04.876 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:04.873+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:05.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1099035 9.81 MB/sec execute 468 sec latency 105.148 ms 2022-09-17T10:39:05.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:05.863+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:06.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1100938 9.81 MB/sec execute 469 sec latency 80.268 ms 2022-09-17T10:39:06.824 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:06.822+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:07.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1101881 9.80 MB/sec execute 470 sec latency 49.828 ms 2022-09-17T10:39:07.824 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:07.821+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:08.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1103579 9.80 MB/sec execute 471 sec latency 84.239 ms 2022-09-17T10:39:08.796 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:08.793+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:09.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1104969 9.80 MB/sec execute 472 sec latency 81.677 ms 2022-09-17T10:39:09.754 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:09.752+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:10.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1105829 9.78 MB/sec execute 473 sec latency 97.215 ms 2022-09-17T10:39:10.741 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:10.738+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:11.066 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1108042 9.79 MB/sec execute 474 sec latency 42.578 ms 2022-09-17T10:39:11.742 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:11.740+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:12.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1108945 9.78 MB/sec execute 475 sec latency 76.649 ms 2022-09-17T10:39:12.750 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:12.746+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:13.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1110714 9.78 MB/sec execute 476 sec latency 54.712 ms 2022-09-17T10:39:13.731 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:13.727+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:14.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1112037 9.78 MB/sec execute 477 sec latency 72.256 ms 2022-09-17T10:39:14.766 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:14.763+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:15.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1112843 9.76 MB/sec execute 478 sec latency 65.366 ms 2022-09-17T10:39:15.760 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:15.757+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:16.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1115084 9.77 MB/sec execute 479 sec latency 18.579 ms 2022-09-17T10:39:16.753 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:16.750+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:17.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1116127 9.76 MB/sec execute 480 sec latency 13.970 ms 2022-09-17T10:39:17.750 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:17.748+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:18.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1118093 9.76 MB/sec execute 481 sec latency 52.265 ms 2022-09-17T10:39:18.775 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:18.773+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:19.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1119143 9.76 MB/sec execute 482 sec latency 317.419 ms 2022-09-17T10:39:19.787 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:19.784+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:20.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1120284 9.75 MB/sec execute 483 sec latency 24.033 ms 2022-09-17T10:39:20.761 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:20.758+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:21.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1122042 9.74 MB/sec execute 484 sec latency 107.892 ms 2022-09-17T10:39:21.766 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:21.763+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:22.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1123037 9.74 MB/sec execute 485 sec latency 60.213 ms 2022-09-17T10:39:22.771 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:22.765+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:23.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1123827 9.73 MB/sec execute 486 sec latency 384.707 ms 2022-09-17T10:39:23.729 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:23.726+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:24.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1125764 9.73 MB/sec execute 487 sec latency 411.324 ms 2022-09-17T10:39:24.719 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:24.716+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:25.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1126756 9.72 MB/sec execute 488 sec latency 17.613 ms 2022-09-17T10:39:25.705 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:25.702+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:26.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1128725 9.72 MB/sec execute 489 sec latency 33.988 ms 2022-09-17T10:39:26.682 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:26.680+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:27.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1129985 9.71 MB/sec execute 490 sec latency 26.440 ms 2022-09-17T10:39:27.727 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:27.724+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:28.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1131822 9.71 MB/sec execute 491 sec latency 22.673 ms 2022-09-17T10:39:28.703 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:28.701+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:29.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1133356 9.71 MB/sec execute 492 sec latency 48.255 ms 2022-09-17T10:39:29.732 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:29.729+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:30.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1134265 9.70 MB/sec execute 493 sec latency 85.906 ms 2022-09-17T10:39:30.746 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:30.743+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:31.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1136132 9.70 MB/sec execute 494 sec latency 76.749 ms 2022-09-17T10:39:31.708 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:31.706+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:32.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1137395 9.69 MB/sec execute 495 sec latency 15.267 ms 2022-09-17T10:39:32.690 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:32.687+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:33.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1139212 9.69 MB/sec execute 496 sec latency 129.556 ms 2022-09-17T10:39:33.720 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:33.717+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:34.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1140143 9.69 MB/sec execute 497 sec latency 633.275 ms 2022-09-17T10:39:34.745 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:34.742+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:35.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1141182 9.68 MB/sec execute 498 sec latency 665.536 ms 2022-09-17T10:39:35.705 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:35.702+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:36.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1143585 9.68 MB/sec execute 499 sec latency 50.482 ms 2022-09-17T10:39:36.749 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:36.746+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:37.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1144617 9.67 MB/sec execute 500 sec latency 87.985 ms 2022-09-17T10:39:37.707 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:37.704+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:38.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1146748 9.68 MB/sec execute 501 sec latency 121.962 ms 2022-09-17T10:39:38.734 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:38.731+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:39.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1147527 9.67 MB/sec execute 502 sec latency 564.346 ms 2022-09-17T10:39:39.687 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:39.684+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:40.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1148811 9.66 MB/sec execute 503 sec latency 581.163 ms 2022-09-17T10:39:40.694 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:40.692+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:41.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1151074 9.67 MB/sec execute 504 sec latency 23.865 ms 2022-09-17T10:39:41.710 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:41.707+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:42.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1152119 9.66 MB/sec execute 505 sec latency 42.087 ms 2022-09-17T10:39:42.747 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:42.744+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:43.057 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1154172 9.66 MB/sec execute 506 sec latency 92.690 ms 2022-09-17T10:39:43.770 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:43.767+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:44.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1155192 9.65 MB/sec execute 507 sec latency 30.620 ms 2022-09-17T10:39:44.752 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:44.750+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:45.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1157312 9.66 MB/sec execute 508 sec latency 16.221 ms 2022-09-17T10:39:45.797 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:45.794+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:46.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1158603 9.65 MB/sec execute 509 sec latency 14.901 ms 2022-09-17T10:39:46.754 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:46.752+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:47.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1160345 9.65 MB/sec execute 510 sec latency 95.948 ms 2022-09-17T10:39:47.777 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:47.775+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:48.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1161759 9.65 MB/sec execute 511 sec latency 84.701 ms 2022-09-17T10:39:48.744 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:48.741+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:49.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1162980 9.64 MB/sec execute 512 sec latency 34.530 ms 2022-09-17T10:39:49.790 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:49.787+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:50.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1165107 9.65 MB/sec execute 513 sec latency 35.496 ms 2022-09-17T10:39:50.783 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:50.780+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 22 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:51.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1166007 9.63 MB/sec execute 514 sec latency 51.590 ms 2022-09-17T10:39:51.738 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:51.735+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:52.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1168591 9.65 MB/sec execute 515 sec latency 26.967 ms 2022-09-17T10:39:52.707 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:52.705+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:53.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1169560 9.63 MB/sec execute 516 sec latency 56.346 ms 2022-09-17T10:39:53.716 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:53.713+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:54.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1172104 9.65 MB/sec execute 517 sec latency 32.005 ms 2022-09-17T10:39:54.761 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:54.759+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:55.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1173295 9.64 MB/sec execute 518 sec latency 14.167 ms 2022-09-17T10:39:55.741 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:55.738+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:56.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1175795 9.65 MB/sec execute 519 sec latency 14.569 ms 2022-09-17T10:39:56.777 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:56.774+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:57.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1176878 9.64 MB/sec execute 520 sec latency 35.028 ms 2022-09-17T10:39:57.798 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:57.795+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:58.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1179279 9.65 MB/sec execute 521 sec latency 52.399 ms 2022-09-17T10:39:58.833 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:58.825+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:39:59.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1179671 9.63 MB/sec execute 522 sec latency 338.088 ms 2022-09-17T10:39:59.822 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:39:59.819+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:00.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1180355 9.62 MB/sec execute 523 sec latency 620.933 ms 2022-09-17T10:40:00.820 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:00.817+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:01.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1182556 9.62 MB/sec execute 524 sec latency 37.948 ms 2022-09-17T10:40:01.848 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:01.846+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:02.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1183508 9.61 MB/sec execute 525 sec latency 45.153 ms 2022-09-17T10:40:02.898 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:02.895+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:03.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1185663 9.62 MB/sec execute 526 sec latency 72.615 ms 2022-09-17T10:40:03.885 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:03.883+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:04.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1186872 9.61 MB/sec execute 527 sec latency 76.212 ms 2022-09-17T10:40:04.852 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:04.849+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:05.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1188788 9.61 MB/sec execute 528 sec latency 57.268 ms 2022-09-17T10:40:05.858 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:05.855+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:06.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1190459 9.61 MB/sec execute 529 sec latency 25.079 ms 2022-09-17T10:40:06.858 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:06.855+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:07.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1192620 9.62 MB/sec execute 530 sec latency 42.875 ms 2022-09-17T10:40:07.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:07.863+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:08.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1193958 9.61 MB/sec execute 531 sec latency 105.399 ms 2022-09-17T10:40:08.901 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:08.898+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:09.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1195872 9.61 MB/sec execute 532 sec latency 40.864 ms 2022-09-17T10:40:09.866 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:09.863+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:10.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1197329 9.61 MB/sec execute 533 sec latency 83.846 ms 2022-09-17T10:40:10.860 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:10.857+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:11.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1199319 9.61 MB/sec execute 534 sec latency 15.726 ms 2022-09-17T10:40:11.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:11.862+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:12.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1200906 9.61 MB/sec execute 535 sec latency 16.098 ms 2022-09-17T10:40:12.885 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:12.882+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:13.059 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1202863 9.61 MB/sec execute 536 sec latency 37.338 ms 2022-09-17T10:40:13.867 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:13.865+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:14.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1204025 9.61 MB/sec execute 537 sec latency 404.232 ms 2022-09-17T10:40:14.874 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:14.872+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:15.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1204753 9.59 MB/sec execute 538 sec latency 619.450 ms 2022-09-17T10:40:15.838 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:15.835+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:16.059 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1206936 9.60 MB/sec execute 539 sec latency 18.558 ms 2022-09-17T10:40:16.802 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:16.800+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:17.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1208121 9.59 MB/sec execute 540 sec latency 51.169 ms 2022-09-17T10:40:17.801 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:17.798+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:18.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1209763 9.59 MB/sec execute 541 sec latency 148.557 ms 2022-09-17T10:40:18.787 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:18.784+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:19.058 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1211327 9.59 MB/sec execute 542 sec latency 60.243 ms 2022-09-17T10:40:19.775 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:19.772+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:20.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1211797 9.58 MB/sec execute 543 sec latency 261.810 ms 2022-09-17T10:40:20.738 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:20.735+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:21.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1213611 9.57 MB/sec execute 544 sec latency 35.146 ms 2022-09-17T10:40:21.733 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:21.720+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:22.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1215127 9.58 MB/sec execute 545 sec latency 29.257 ms 2022-09-17T10:40:22.732 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:22.730+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:23.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1217040 9.57 MB/sec execute 546 sec latency 21.062 ms 2022-09-17T10:40:23.746 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:23.743+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 22 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:24.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1218626 9.58 MB/sec execute 547 sec latency 12.406 ms 2022-09-17T10:40:24.710 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:24.707+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:25.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1220506 9.57 MB/sec execute 548 sec latency 79.365 ms 2022-09-17T10:40:25.706 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:25.703+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:26.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1222140 9.58 MB/sec execute 549 sec latency 23.872 ms 2022-09-17T10:40:26.746 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:26.744+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:27.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1223393 9.57 MB/sec execute 550 sec latency 77.544 ms 2022-09-17T10:40:27.739 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:27.737+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:28.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1225526 9.58 MB/sec execute 551 sec latency 27.638 ms 2022-09-17T10:40:28.750 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:28.748+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:29.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1226489 9.56 MB/sec execute 552 sec latency 95.865 ms 2022-09-17T10:40:29.744 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:29.741+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:30.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1228670 9.57 MB/sec execute 553 sec latency 50.415 ms 2022-09-17T10:40:30.763 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:30.761+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:31.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1229649 9.56 MB/sec execute 554 sec latency 16.284 ms 2022-09-17T10:40:31.789 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:31.787+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:32.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1231292 9.55 MB/sec execute 555 sec latency 68.228 ms 2022-09-17T10:40:32.802 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:32.801+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:33.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1232752 9.56 MB/sec execute 556 sec latency 29.600 ms 2022-09-17T10:40:33.778 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:33.775+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:34.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1233802 9.55 MB/sec execute 557 sec latency 91.062 ms 2022-09-17T10:40:34.762 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:34.760+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:35.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1235747 9.55 MB/sec execute 558 sec latency 59.912 ms 2022-09-17T10:40:35.797 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:35.796+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:36.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1236724 9.54 MB/sec execute 559 sec latency 26.826 ms 2022-09-17T10:40:36.811 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:36.809+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:37.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1238364 9.54 MB/sec execute 560 sec latency 140.107 ms 2022-09-17T10:40:37.858 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:37.855+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:38.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1239801 9.54 MB/sec execute 561 sec latency 19.611 ms 2022-09-17T10:40:38.868 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:38.866+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:39.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1240971 9.53 MB/sec execute 562 sec latency 25.728 ms 2022-09-17T10:40:39.856 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:39.855+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:40.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1243185 9.54 MB/sec execute 563 sec latency 13.226 ms 2022-09-17T10:40:40.885 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:40.883+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:41.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1244473 9.53 MB/sec execute 564 sec latency 18.885 ms 2022-09-17T10:40:41.847 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:41.845+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:42.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1246729 9.54 MB/sec execute 565 sec latency 16.910 ms 2022-09-17T10:40:42.844 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:42.843+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:43.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1247476 9.53 MB/sec execute 566 sec latency 104.086 ms 2022-09-17T10:40:43.853 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:43.851+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:44.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1249875 9.53 MB/sec execute 567 sec latency 39.390 ms 2022-09-17T10:40:44.840 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:44.838+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:45.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1251003 9.53 MB/sec execute 568 sec latency 13.528 ms 2022-09-17T10:40:45.833 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:45.832+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:46.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1253035 9.53 MB/sec execute 569 sec latency 145.781 ms 2022-09-17T10:40:46.803 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:46.802+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:47.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1254348 9.53 MB/sec execute 570 sec latency 13.679 ms 2022-09-17T10:40:47.801 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:47.800+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:48.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1256227 9.52 MB/sec execute 571 sec latency 42.742 ms 2022-09-17T10:40:48.810 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:48.808+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:49.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1257594 9.53 MB/sec execute 572 sec latency 74.857 ms 2022-09-17T10:40:49.832 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:49.830+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:50.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1259100 9.52 MB/sec execute 573 sec latency 20.865 ms 2022-09-17T10:40:50.827 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:50.825+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:51.066 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1261016 9.52 MB/sec execute 574 sec latency 33.149 ms 2022-09-17T10:40:51.851 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:51.850+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:52.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1261976 9.51 MB/sec execute 575 sec latency 84.999 ms 2022-09-17T10:40:52.878 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:52.876+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:53.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1264376 9.52 MB/sec execute 576 sec latency 14.132 ms 2022-09-17T10:40:53.911 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:53.909+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:54.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1265182 9.51 MB/sec execute 577 sec latency 79.924 ms 2022-09-17T10:40:54.952 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:54.950+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:55.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1266902 9.51 MB/sec execute 578 sec latency 65.009 ms 2022-09-17T10:40:55.960 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:55.959+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:56.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1268309 9.51 MB/sec execute 579 sec latency 30.736 ms 2022-09-17T10:40:56.984 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:56.983+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:57.060 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1270224 9.50 MB/sec execute 580 sec latency 19.125 ms 2022-09-17T10:40:57.982 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:57.980+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:58.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1271710 9.51 MB/sec execute 581 sec latency 23.845 ms 2022-09-17T10:40:58.988 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:40:58.986+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:40:59.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1272798 9.50 MB/sec execute 582 sec latency 65.199 ms 2022-09-17T10:41:00.037 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:00.035+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:00.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1274575 9.50 MB/sec execute 583 sec latency 65.754 ms 2022-09-17T10:41:01.003 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:01.001+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:01.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1275604 9.49 MB/sec execute 584 sec latency 77.800 ms 2022-09-17T10:41:01.987 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:01.986+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:02.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1277327 9.49 MB/sec execute 585 sec latency 65.553 ms 2022-09-17T10:41:02.948 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:02.946+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:03.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1278801 9.49 MB/sec execute 586 sec latency 16.619 ms 2022-09-17T10:41:03.921 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:03.920+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:04.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1280002 9.49 MB/sec execute 587 sec latency 16.050 ms 2022-09-17T10:41:04.970 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:04.969+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:05.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1282001 9.49 MB/sec execute 588 sec latency 35.451 ms 2022-09-17T10:41:06.011 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:06.009+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:06.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1282049 9.47 MB/sec execute 589 sec latency 637.312 ms 2022-09-17T10:41:07.058 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:07.057+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:07.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1282901 9.46 MB/sec execute 590 sec latency 33.747 ms 2022-09-17T10:41:08.013 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:08.011+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:08.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1284794 9.46 MB/sec execute 591 sec latency 39.579 ms 2022-09-17T10:41:09.057 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:09.055+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:09.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1286005 9.46 MB/sec execute 592 sec latency 50.110 ms 2022-09-17T10:41:10.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1287446 9.45 MB/sec execute 593 sec latency 80.398 ms 2022-09-17T10:41:10.073 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:10.071+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:11.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1289275 9.46 MB/sec execute 594 sec latency 56.950 ms 2022-09-17T10:41:11.112 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:11.111+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:12.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1289986 9.45 MB/sec execute 595 sec latency 193.239 ms 2022-09-17T10:41:12.132 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:12.131+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:13.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1291728 9.44 MB/sec execute 596 sec latency 72.198 ms 2022-09-17T10:41:13.143 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:13.142+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:14.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1293065 9.45 MB/sec execute 597 sec latency 137.770 ms 2022-09-17T10:41:14.150 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:14.148+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:15.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1294518 9.44 MB/sec execute 598 sec latency 16.638 ms 2022-09-17T10:41:15.124 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:15.122+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:16.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 1296244 9.44 MB/sec execute 599 sec latency 151.330 ms 2022-09-17T10:41:16.153 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:16.151+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:17.061 INFO:tasks.workunit.client.0.smithi062.stdout: 1 cleanup 600 sec 2022-09-17T10:41:17.120 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:17.118+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:17.229 INFO:tasks.workunit.client.0.smithi062.stdout: 0 cleanup 600 sec 2022-09-17T10:41:17.230 INFO:tasks.workunit.client.0.smithi062.stdout: 2022-09-17T10:41:17.230 INFO:tasks.workunit.client.0.smithi062.stdout: Operation Count AvgLat MaxLat 2022-09-17T10:41:17.230 INFO:tasks.workunit.client.0.smithi062.stdout: ---------------------------------------- 2022-09-17T10:41:17.231 INFO:tasks.workunit.client.0.smithi062.stdout: NTCreateX 180320 1.185 698.256 2022-09-17T10:41:17.231 INFO:tasks.workunit.client.0.smithi062.stdout: Close 132423 0.002 15.525 2022-09-17T10:41:17.231 INFO:tasks.workunit.client.0.smithi062.stdout: Rename 7637 5.694 322.418 2022-09-17T10:41:17.231 INFO:tasks.workunit.client.0.smithi062.stdout: Unlink 36442 1.970 581.155 2022-09-17T10:41:17.232 INFO:tasks.workunit.client.0.smithi062.stdout: Deltree 4 84.878 109.767 2022-09-17T10:41:17.232 INFO:tasks.workunit.client.0.smithi062.stdout: Mkdir 2 0.007 0.008 2022-09-17T10:41:17.232 INFO:tasks.workunit.client.0.smithi062.stdout: Qpathinfo 163448 0.924 637.302 2022-09-17T10:41:17.232 INFO:tasks.workunit.client.0.smithi062.stdout: Qfileinfo 28623 0.001 0.024 2022-09-17T10:41:17.233 INFO:tasks.workunit.client.0.smithi062.stdout: Qfsinfo 29988 0.140 9.829 2022-09-17T10:41:17.233 INFO:tasks.workunit.client.0.smithi062.stdout: Sfileinfo 14681 0.023 39.059 2022-09-17T10:41:17.233 INFO:tasks.workunit.client.0.smithi062.stdout: Find 63205 0.132 170.482 2022-09-17T10:41:17.233 INFO:tasks.workunit.client.0.smithi062.stdout: WriteX 89807 0.023 235.917 2022-09-17T10:41:17.234 INFO:tasks.workunit.client.0.smithi062.stdout: ReadX 282791 0.026 344.016 2022-09-17T10:41:17.234 INFO:tasks.workunit.client.0.smithi062.stdout: LockX 588 1.263 27.710 2022-09-17T10:41:17.234 INFO:tasks.workunit.client.0.smithi062.stdout: UnlockX 588 1.020 17.868 2022-09-17T10:41:17.235 INFO:tasks.workunit.client.0.smithi062.stdout: Flush 12636 7.405 536.773 2022-09-17T10:41:17.235 INFO:tasks.workunit.client.0.smithi062.stdout: 2022-09-17T10:41:17.235 INFO:tasks.workunit.client.0.smithi062.stdout:Throughput 9.44419 MB/sec 1 clients 1 procs max_latency=698.261 ms 2022-09-17T10:41:17.242 INFO:tasks.workunit.client.0.smithi062.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2022-09-17T10:41:17.242 INFO:tasks.workunit.client.0.smithi062.stdout: 2022-09-17T10:41:17.242 INFO:tasks.workunit.client.0.smithi062.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2022-09-17T10:41:17.243 INFO:tasks.workunit.client.0.smithi062.stdout:8 of 10 processes prepared for launch 0 sec 2022-09-17T10:41:17.343 INFO:tasks.workunit.client.0.smithi062.stdout:10 of 10 processes prepared for launch 0 sec 2022-09-17T10:41:17.344 INFO:tasks.workunit.client.0.smithi062.stdout:releasing clients 2022-09-17T10:41:18.152 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:18.150+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:18.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 291 108.08 MB/sec warmup 1 sec latency 50.017 ms 2022-09-17T10:41:19.161 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:19.159+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:19.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 542 93.29 MB/sec warmup 2 sec latency 45.953 ms 2022-09-17T10:41:20.148 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:20.146+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:20.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 909 72.40 MB/sec warmup 3 sec latency 57.245 ms 2022-09-17T10:41:21.116 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:21.114+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:21.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 939 54.45 MB/sec warmup 4 sec latency 750.889 ms 2022-09-17T10:41:22.128 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:22.127+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:22.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 1247 47.29 MB/sec warmup 5 sec latency 769.498 ms 2022-09-17T10:41:23.162 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:23.160+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:23.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 1697 43.72 MB/sec warmup 6 sec latency 71.449 ms 2022-09-17T10:41:24.142 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:24.141+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:24.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 2404 40.01 MB/sec warmup 7 sec latency 50.086 ms 2022-09-17T10:41:25.148 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:25.146+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:25.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 2783 39.98 MB/sec warmup 8 sec latency 110.994 ms 2022-09-17T10:41:26.191 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:26.190+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:26.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 3262 38.70 MB/sec warmup 9 sec latency 53.613 ms 2022-09-17T10:41:27.217 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:27.215+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:27.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 3645 38.65 MB/sec warmup 10 sec latency 53.663 ms 2022-09-17T10:41:28.238 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:28.236+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:28.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 3809 36.15 MB/sec warmup 11 sec latency 99.313 ms 2022-09-17T10:41:29.266 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:29.265+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:29.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 3937 33.36 MB/sec warmup 12 sec latency 68.363 ms 2022-09-17T10:41:30.282 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:30.281+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:30.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 4080 30.83 MB/sec warmup 13 sec latency 59.034 ms 2022-09-17T10:41:30.468 INFO:tasks.ceph.osd.2.smithi159.stderr:2022-09-17T10:41:30.466+0000 7ff47a94b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86752) UID: 0 2022-09-17T10:41:30.468 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:30.466+0000 7f3cadcf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86752) UID: 0 2022-09-17T10:41:30.469 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T10:41:30.466+0000 7ff583417700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86752) UID: 0 2022-09-17T10:41:30.470 INFO:tasks.ceph.osd.11.smithi159.stderr:2022-09-17T10:41:30.466+0000 7f226e83e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86752) UID: 0 2022-09-17T10:41:31.308 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:31.306+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:31.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 4232 28.73 MB/sec warmup 14 sec latency 148.126 ms 2022-09-17T10:41:32.289 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:32.287+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:32.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 4451 27.17 MB/sec warmup 15 sec latency 230.655 ms 2022-09-17T10:41:33.272 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:33.270+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 4747 26.34 MB/sec warmup 16 sec latency 299.001 ms 2022-09-17T10:41:34.295 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:34.293+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:34.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 5177 26.64 MB/sec warmup 17 sec latency 69.439 ms 2022-09-17T10:41:35.262 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:35.260+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:35.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 5843 25.90 MB/sec warmup 18 sec latency 160.777 ms 2022-09-17T10:41:36.258 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:36.256+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:36.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 6124 25.28 MB/sec warmup 19 sec latency 50.819 ms 2022-09-17T10:41:37.307 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:37.305+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:37.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 6608 26.41 MB/sec warmup 20 sec latency 64.240 ms 2022-09-17T10:41:38.293 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:38.291+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:38.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 7061 27.11 MB/sec warmup 21 sec latency 61.328 ms 2022-09-17T10:41:39.268 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:39.267+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:39.343 INFO:tasks.workunit.client.0.smithi062.stdout: 10 7288 26.58 MB/sec warmup 22 sec latency 83.598 ms 2022-09-17T10:41:40.309 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:40.307+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:40.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 7347 25.60 MB/sec warmup 23 sec latency 464.684 ms 2022-09-17T10:41:41.286 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:41.285+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:41.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 7482 24.66 MB/sec warmup 24 sec latency 70.357 ms 2022-09-17T10:41:42.304 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:42.303+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:42.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 7608 23.68 MB/sec warmup 25 sec latency 61.635 ms 2022-09-17T10:41:43.323 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:43.321+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:43.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 7742 22.80 MB/sec warmup 26 sec latency 136.943 ms 2022-09-17T10:41:44.284 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:44.282+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:44.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 8004 22.19 MB/sec warmup 27 sec latency 154.304 ms 2022-09-17T10:41:45.267 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:45.265+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:45.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 8381 22.21 MB/sec warmup 28 sec latency 55.963 ms 2022-09-17T10:41:46.224 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:46.221+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:46.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 8881 22.25 MB/sec warmup 29 sec latency 59.616 ms 2022-09-17T10:41:47.217 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:47.216+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:47.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 9527 22.12 MB/sec warmup 30 sec latency 50.255 ms 2022-09-17T10:41:48.261 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:48.260+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:48.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 9947 22.81 MB/sec warmup 31 sec latency 51.327 ms 2022-09-17T10:41:49.237 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:49.236+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:49.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 10394 22.91 MB/sec warmup 32 sec latency 76.299 ms 2022-09-17T10:41:50.284 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:50.283+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:50.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 10731 23.29 MB/sec warmup 33 sec latency 59.180 ms 2022-09-17T10:41:51.245 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:51.243+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:51.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 10893 22.94 MB/sec warmup 34 sec latency 88.090 ms 2022-09-17T10:41:52.245 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:52.243+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:52.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 11023 22.36 MB/sec warmup 35 sec latency 76.604 ms 2022-09-17T10:41:53.276 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:53.274+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:53.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 11142 21.75 MB/sec warmup 36 sec latency 72.481 ms 2022-09-17T10:41:54.292 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:54.290+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:54.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 11273 21.19 MB/sec warmup 37 sec latency 218.856 ms 2022-09-17T10:41:55.261 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:55.259+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:55.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 11468 20.74 MB/sec warmup 38 sec latency 383.675 ms 2022-09-17T10:41:56.296 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:56.293+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:56.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 11751 20.58 MB/sec warmup 39 sec latency 125.249 ms 2022-09-17T10:41:57.300 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:57.298+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:57.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 11916 20.32 MB/sec warmup 40 sec latency 551.431 ms 2022-09-17T10:41:58.262 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:58.260+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:58.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 12360 20.39 MB/sec warmup 41 sec latency 75.959 ms 2022-09-17T10:41:59.289 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:41:59.287+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:41:59.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 12934 20.24 MB/sec warmup 42 sec latency 82.054 ms 2022-09-17T10:42:00.327 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:00.325+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:00.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 13289 20.31 MB/sec warmup 43 sec latency 63.485 ms 2022-09-17T10:42:01.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 13758 20.82 MB/sec warmup 44 sec latency 53.551 ms 2022-09-17T10:42:01.369 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:01.364+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:02.329 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:02.327+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:02.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 13814 20.42 MB/sec warmup 45 sec latency 828.086 ms 2022-09-17T10:42:03.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 13826 20.04 MB/sec warmup 46 sec latency 1592.384 ms 2022-09-17T10:42:03.378 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:03.375+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:04.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 13874 19.67 MB/sec warmup 47 sec latency 1937.887 ms 2022-09-17T10:42:04.358 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:04.356+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:05.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 14154 19.78 MB/sec warmup 48 sec latency 122.418 ms 2022-09-17T10:42:05.352 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:05.349+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:06.343 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:06.340+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:06.344 INFO:tasks.workunit.client.0.smithi062.stdout: 10 14310 19.64 MB/sec warmup 49 sec latency 150.480 ms 2022-09-17T10:42:07.324 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:07.321+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:07.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 14454 19.42 MB/sec warmup 50 sec latency 94.186 ms 2022-09-17T10:42:08.300 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:08.299+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:08.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 14571 19.09 MB/sec warmup 51 sec latency 67.884 ms 2022-09-17T10:42:09.287 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:09.284+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:09.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 14692 18.74 MB/sec warmup 52 sec latency 73.575 ms 2022-09-17T10:42:10.250 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:10.247+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:10.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 14848 18.42 MB/sec warmup 53 sec latency 86.883 ms 2022-09-17T10:42:11.227 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:11.224+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:11.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 15011 18.14 MB/sec warmup 54 sec latency 154.579 ms 2022-09-17T10:42:12.271 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:12.269+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:12.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 15274 17.98 MB/sec warmup 55 sec latency 134.503 ms 2022-09-17T10:42:13.263 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:13.244+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:13.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 15541 17.99 MB/sec warmup 56 sec latency 97.730 ms 2022-09-17T10:42:14.226 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:14.223+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:14.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 15923 18.03 MB/sec warmup 57 sec latency 95.126 ms 2022-09-17T10:42:15.192 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:15.189+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:15.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 16392 17.87 MB/sec warmup 58 sec latency 95.831 ms 2022-09-17T10:42:16.174 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:16.172+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:16.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 16718 17.89 MB/sec warmup 59 sec latency 102.988 ms 2022-09-17T10:42:17.175 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:17.172+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 11 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:17.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 17054 18.10 MB/sec warmup 60 sec latency 73.939 ms 2022-09-17T10:42:18.201 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:18.198+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:18.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 17384 18.27 MB/sec warmup 61 sec latency 74.884 ms 2022-09-17T10:42:19.244 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:19.240+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:19.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 17737 18.45 MB/sec warmup 62 sec latency 86.300 ms 2022-09-17T10:42:20.254 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:20.252+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:20.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 17932 18.37 MB/sec warmup 63 sec latency 96.980 ms 2022-09-17T10:42:21.303 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:21.300+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 18044 18.18 MB/sec warmup 64 sec latency 90.062 ms 2022-09-17T10:42:22.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 18088 17.91 MB/sec warmup 65 sec latency 322.227 ms 2022-09-17T10:42:22.353 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:22.349+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:23.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 18134 17.65 MB/sec warmup 66 sec latency 453.553 ms 2022-09-17T10:42:23.360 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:23.341+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:24.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 18238 17.40 MB/sec warmup 67 sec latency 88.567 ms 2022-09-17T10:42:24.360 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:24.357+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:25.340 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:25.337+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:25.345 INFO:tasks.workunit.client.0.smithi062.stdout: 10 18346 17.15 MB/sec warmup 68 sec latency 283.450 ms 2022-09-17T10:42:26.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 18500 16.95 MB/sec warmup 69 sec latency 252.408 ms 2022-09-17T10:42:26.348 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:26.344+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:27.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 18696 16.79 MB/sec warmup 70 sec latency 80.031 ms 2022-09-17T10:42:27.409 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:27.406+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:28.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 18907 16.69 MB/sec warmup 71 sec latency 142.237 ms 2022-09-17T10:42:28.453 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:28.451+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:29.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 19212 16.86 MB/sec warmup 72 sec latency 93.200 ms 2022-09-17T10:42:29.489 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:29.486+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:30.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 19566 16.70 MB/sec warmup 73 sec latency 214.244 ms 2022-09-17T10:42:30.477 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:30.474+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:31.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 20097 16.67 MB/sec warmup 74 sec latency 89.552 ms 2022-09-17T10:42:31.442 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:31.441+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:32.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 20314 16.62 MB/sec warmup 75 sec latency 72.610 ms 2022-09-17T10:42:32.487 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:32.486+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:33.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 20615 16.84 MB/sec warmup 76 sec latency 103.004 ms 2022-09-17T10:42:33.458 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:33.455+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 20942 16.87 MB/sec warmup 77 sec latency 75.174 ms 2022-09-17T10:42:34.475 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:34.458+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:35.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 21247 17.02 MB/sec warmup 78 sec latency 91.197 ms 2022-09-17T10:42:35.431 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:35.429+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:36.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 21453 17.04 MB/sec warmup 79 sec latency 82.725 ms 2022-09-17T10:42:36.399 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:36.397+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:37.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 21574 16.91 MB/sec warmup 80 sec latency 90.624 ms 2022-09-17T10:42:37.455 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:37.452+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:38.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 21666 16.74 MB/sec warmup 81 sec latency 96.451 ms 2022-09-17T10:42:38.440 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:38.437+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:39.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 21759 16.55 MB/sec warmup 82 sec latency 82.827 ms 2022-09-17T10:42:39.479 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:39.477+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:40.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 21858 16.35 MB/sec warmup 83 sec latency 135.157 ms 2022-09-17T10:42:40.460 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:40.457+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:41.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 21993 16.18 MB/sec warmup 84 sec latency 105.497 ms 2022-09-17T10:42:41.484 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:41.465+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 11 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:42.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 22173 16.04 MB/sec warmup 85 sec latency 116.229 ms 2022-09-17T10:42:42.476 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:42.473+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:43.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 22432 16.04 MB/sec warmup 86 sec latency 83.464 ms 2022-09-17T10:42:43.440 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:43.436+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:44.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 22591 15.94 MB/sec warmup 87 sec latency 338.784 ms 2022-09-17T10:42:44.448 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:44.445+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:45.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 22984 16.02 MB/sec warmup 88 sec latency 80.286 ms 2022-09-17T10:42:45.439 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:45.436+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:46.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 23448 15.94 MB/sec warmup 89 sec latency 76.476 ms 2022-09-17T10:42:46.470 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:46.452+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:47.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 23838 15.97 MB/sec warmup 90 sec latency 71.978 ms 2022-09-17T10:42:47.426 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:47.425+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:48.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 24176 16.12 MB/sec warmup 91 sec latency 69.160 ms 2022-09-17T10:42:48.481 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:48.479+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:49.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 24573 16.32 MB/sec warmup 92 sec latency 68.071 ms 2022-09-17T10:42:49.473 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:49.471+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:50.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 24883 16.40 MB/sec warmup 93 sec latency 89.778 ms 2022-09-17T10:42:50.432 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:50.429+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:51.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 25078 16.41 MB/sec warmup 94 sec latency 101.844 ms 2022-09-17T10:42:51.385 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:51.383+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:52.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 25195 16.28 MB/sec warmup 95 sec latency 70.260 ms 2022-09-17T10:42:52.415 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:52.403+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:53.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 25312 16.13 MB/sec warmup 96 sec latency 90.006 ms 2022-09-17T10:42:53.425 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:53.423+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:54.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 25439 15.97 MB/sec warmup 97 sec latency 69.658 ms 2022-09-17T10:42:54.396 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:54.393+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:55.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 25583 15.83 MB/sec warmup 98 sec latency 311.742 ms 2022-09-17T10:42:55.433 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:55.430+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:56.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 25817 15.75 MB/sec warmup 99 sec latency 221.788 ms 2022-09-17T10:42:56.397 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:56.392+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:57.346 INFO:tasks.workunit.client.0.smithi062.stdout: 10 26128 15.81 MB/sec warmup 100 sec latency 74.895 ms 2022-09-17T10:42:57.422 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:57.419+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:58.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 26281 15.75 MB/sec warmup 101 sec latency 471.600 ms 2022-09-17T10:42:58.472 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:58.469+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:42:59.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 26285 15.59 MB/sec warmup 102 sec latency 1353.831 ms 2022-09-17T10:42:59.425 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:42:59.424+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:00.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 26576 15.55 MB/sec warmup 103 sec latency 1398.222 ms 2022-09-17T10:43:00.450 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:00.447+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:01.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 27063 15.51 MB/sec warmup 104 sec latency 185.986 ms 2022-09-17T10:43:01.444 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:01.442+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:02.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 27376 15.50 MB/sec warmup 105 sec latency 94.896 ms 2022-09-17T10:43:02.482 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:02.480+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:03.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 27753 15.69 MB/sec warmup 106 sec latency 79.654 ms 2022-09-17T10:43:03.438 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:03.435+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:04.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 28183 15.86 MB/sec warmup 107 sec latency 273.123 ms 2022-09-17T10:43:04.457 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:04.455+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:05.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 28490 15.96 MB/sec warmup 108 sec latency 319.836 ms 2022-09-17T10:43:05.493 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:05.491+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:06.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 28654 15.92 MB/sec warmup 109 sec latency 98.823 ms 2022-09-17T10:43:06.473 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:06.470+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:07.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 28778 15.81 MB/sec warmup 110 sec latency 62.263 ms 2022-09-17T10:43:07.483 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:07.480+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:08.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 28898 15.67 MB/sec warmup 111 sec latency 77.032 ms 2022-09-17T10:43:08.526 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:08.524+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 9 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:09.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 29040 15.54 MB/sec warmup 112 sec latency 101.012 ms 2022-09-17T10:43:09.557 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:09.555+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:10.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 29235 15.45 MB/sec warmup 113 sec latency 437.416 ms 2022-09-17T10:43:10.541 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:10.530+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:11.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 29500 15.42 MB/sec warmup 114 sec latency 72.725 ms 2022-09-17T10:43:11.523 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:11.520+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:12.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 29679 15.38 MB/sec warmup 115 sec latency 374.047 ms 2022-09-17T10:43:12.539 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:12.536+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:13.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 30018 15.42 MB/sec warmup 116 sec latency 95.991 ms 2022-09-17T10:43:13.539 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:13.536+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:14.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 30485 15.38 MB/sec warmup 117 sec latency 77.027 ms 2022-09-17T10:43:14.573 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:14.572+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:15.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 30898 15.39 MB/sec warmup 118 sec latency 70.624 ms 2022-09-17T10:43:15.576 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:15.574+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:16.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 31180 15.48 MB/sec warmup 119 sec latency 74.639 ms 2022-09-17T10:43:16.599 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:16.585+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:17.566 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:17.552+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:18.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 31875 30.07 MB/sec execute 1 sec latency 123.361 ms 2022-09-17T10:43:18.556 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:18.553+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:19.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 32077 22.77 MB/sec execute 2 sec latency 93.314 ms 2022-09-17T10:43:19.580 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:19.579+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:20.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 32223 18.67 MB/sec execute 3 sec latency 135.446 ms 2022-09-17T10:43:20.560 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:20.558+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 32324 14.63 MB/sec execute 4 sec latency 75.595 ms 2022-09-17T10:43:21.572 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:21.570+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:22.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 32434 11.90 MB/sec execute 5 sec latency 94.983 ms 2022-09-17T10:43:22.575 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:22.572+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:23.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 32567 10.11 MB/sec execute 6 sec latency 136.995 ms 2022-09-17T10:43:23.607 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:23.603+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:24.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 32760 9.17 MB/sec execute 7 sec latency 134.392 ms 2022-09-17T10:43:24.623 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:24.620+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:25.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 33062 9.98 MB/sec execute 8 sec latency 107.793 ms 2022-09-17T10:43:25.648 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:25.645+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:26.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 33397 10.99 MB/sec execute 9 sec latency 81.854 ms 2022-09-17T10:43:26.711 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:26.694+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:27.347 INFO:tasks.workunit.client.0.smithi062.stdout: 10 33878 11.65 MB/sec execute 10 sec latency 89.808 ms 2022-09-17T10:43:27.719 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:27.702+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:28.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 34343 11.75 MB/sec execute 11 sec latency 111.747 ms 2022-09-17T10:43:28.686 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:28.683+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:29.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 34641 12.97 MB/sec execute 12 sec latency 107.682 ms 2022-09-17T10:43:29.659 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:29.657+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:30.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 35047 14.57 MB/sec execute 13 sec latency 60.426 ms 2022-09-17T10:43:30.683 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:30.667+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:31.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 35416 15.73 MB/sec execute 14 sec latency 88.347 ms 2022-09-17T10:43:31.668 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:31.665+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:32.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 35632 15.91 MB/sec execute 15 sec latency 71.648 ms 2022-09-17T10:43:32.665 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:32.663+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:33.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 35778 15.51 MB/sec execute 16 sec latency 72.605 ms 2022-09-17T10:43:33.693 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:33.688+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:34.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 35833 14.64 MB/sec execute 17 sec latency 359.020 ms 2022-09-17T10:43:34.701 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:34.699+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:35.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 35946 13.93 MB/sec execute 18 sec latency 140.342 ms 2022-09-17T10:43:35.662 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:35.660+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:36.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 36073 13.24 MB/sec execute 19 sec latency 150.368 ms 2022-09-17T10:43:36.672 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:36.671+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:37.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 36223 12.68 MB/sec execute 20 sec latency 82.538 ms 2022-09-17T10:43:37.680 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:37.664+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:38.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 36442 12.42 MB/sec execute 21 sec latency 147.698 ms 2022-09-17T10:43:38.692 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:38.683+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:39.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 36644 12.38 MB/sec execute 22 sec latency 158.867 ms 2022-09-17T10:43:39.690 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:39.687+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:40.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 36948 12.62 MB/sec execute 23 sec latency 95.178 ms 2022-09-17T10:43:40.687 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:40.684+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:41.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 37281 12.76 MB/sec execute 24 sec latency 104.957 ms 2022-09-17T10:43:41.679 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:41.677+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:42.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 37614 12.52 MB/sec execute 25 sec latency 94.317 ms 2022-09-17T10:43:42.659 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:42.656+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:43.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 37971 12.67 MB/sec execute 26 sec latency 80.607 ms 2022-09-17T10:43:43.642 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:43.626+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:44.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 38077 12.51 MB/sec execute 27 sec latency 529.690 ms 2022-09-17T10:43:44.708 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:44.673+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:45.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 38079 12.06 MB/sec execute 28 sec latency 1163.471 ms 2022-09-17T10:43:45.635 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:45.633+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:46.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 38080 11.65 MB/sec execute 29 sec latency 2000.108 ms 2022-09-17T10:43:46.617 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:46.615+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:47.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 38199 11.54 MB/sec execute 30 sec latency 1988.287 ms 2022-09-17T10:43:47.587 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:47.585+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:48.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 38486 12.02 MB/sec execute 31 sec latency 160.813 ms 2022-09-17T10:43:48.599 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:48.596+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:49.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 38687 12.18 MB/sec execute 32 sec latency 136.992 ms 2022-09-17T10:43:49.659 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:49.656+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:50.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 38943 12.30 MB/sec execute 33 sec latency 113.628 ms 2022-09-17T10:43:50.637 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:50.634+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:51.348 INFO:tasks.workunit.client.0.smithi062.stdout: 10 39156 12.65 MB/sec execute 34 sec latency 148.900 ms 2022-09-17T10:43:51.620 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:51.617+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:52.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 39278 12.44 MB/sec execute 35 sec latency 81.756 ms 2022-09-17T10:43:52.653 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:52.651+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:53.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 39372 12.22 MB/sec execute 36 sec latency 110.457 ms 2022-09-17T10:43:53.654 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:53.651+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:54.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 39467 11.93 MB/sec execute 37 sec latency 95.673 ms 2022-09-17T10:43:54.616 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:54.615+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:55.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 39579 11.64 MB/sec execute 38 sec latency 99.830 ms 2022-09-17T10:43:55.666 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:55.649+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:56.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 39702 11.38 MB/sec execute 39 sec latency 195.816 ms 2022-09-17T10:43:56.713 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:56.710+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:57.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 39879 11.23 MB/sec execute 40 sec latency 77.394 ms 2022-09-17T10:43:57.702 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:57.700+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:58.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 40086 11.12 MB/sec execute 41 sec latency 95.164 ms 2022-09-17T10:43:58.752 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:58.749+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:43:59.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 40404 11.39 MB/sec execute 42 sec latency 84.834 ms 2022-09-17T10:43:59.759 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:43:59.756+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:00.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 40819 11.42 MB/sec execute 43 sec latency 88.106 ms 2022-09-17T10:44:00.793 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:00.792+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:01.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 41182 11.50 MB/sec execute 44 sec latency 139.919 ms 2022-09-17T10:44:01.791 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:01.789+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:02.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 41608 11.81 MB/sec execute 45 sec latency 81.308 ms 2022-09-17T10:44:02.799 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:02.796+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:03.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 41947 12.03 MB/sec execute 46 sec latency 141.117 ms 2022-09-17T10:44:03.833 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:03.830+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:04.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 42333 12.58 MB/sec execute 47 sec latency 61.039 ms 2022-09-17T10:44:04.884 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:04.880+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:05.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 42625 12.75 MB/sec execute 48 sec latency 64.038 ms 2022-09-17T10:44:05.919 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:05.916+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 15 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:06.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 42772 12.70 MB/sec execute 49 sec latency 109.461 ms 2022-09-17T10:44:06.925 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:06.921+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:07.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 42898 12.59 MB/sec execute 50 sec latency 94.528 ms 2022-09-17T10:44:07.895 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:07.892+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:08.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 43002 12.39 MB/sec execute 51 sec latency 79.053 ms 2022-09-17T10:44:08.850 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:08.848+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:09.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 43110 12.17 MB/sec execute 52 sec latency 155.811 ms 2022-09-17T10:44:09.821 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:09.818+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:10.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 43151 11.96 MB/sec execute 53 sec latency 454.363 ms 2022-09-17T10:44:10.822 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:10.815+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:11.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 43260 11.77 MB/sec execute 54 sec latency 540.607 ms 2022-09-17T10:44:11.858 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:11.853+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:12.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 43393 11.60 MB/sec execute 55 sec latency 185.096 ms 2022-09-17T10:44:12.855 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:12.853+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:13.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 43575 11.55 MB/sec execute 56 sec latency 166.843 ms 2022-09-17T10:44:13.876 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:13.852+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:14.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 43828 11.70 MB/sec execute 57 sec latency 96.164 ms 2022-09-17T10:44:14.834 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:14.830+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:15.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 44054 11.58 MB/sec execute 58 sec latency 94.674 ms 2022-09-17T10:44:15.868 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:15.865+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:16.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 44456 11.65 MB/sec execute 59 sec latency 135.207 ms 2022-09-17T10:44:16.890 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:16.886+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:17.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 44728 11.61 MB/sec execute 60 sec latency 101.684 ms 2022-09-17T10:44:17.859 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:17.856+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:18.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 44980 11.56 MB/sec execute 61 sec latency 125.013 ms 2022-09-17T10:44:18.887 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:18.883+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:19.349 INFO:tasks.workunit.client.0.smithi062.stdout: 10 45265 11.79 MB/sec execute 62 sec latency 128.253 ms 2022-09-17T10:44:19.922 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:19.919+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:20.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 45471 11.77 MB/sec execute 63 sec latency 103.700 ms 2022-09-17T10:44:20.906 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:20.882+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:21.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 45778 12.04 MB/sec execute 64 sec latency 211.318 ms 2022-09-17T10:44:21.918 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:21.915+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:22.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46005 12.17 MB/sec execute 65 sec latency 100.509 ms 2022-09-17T10:44:22.908 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:22.905+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:23.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46111 12.07 MB/sec execute 66 sec latency 190.316 ms 2022-09-17T10:44:23.882 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:23.879+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:24.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46224 12.08 MB/sec execute 67 sec latency 209.095 ms 2022-09-17T10:44:24.954 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:24.950+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:25.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46313 11.96 MB/sec execute 68 sec latency 119.382 ms 2022-09-17T10:44:25.963 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:25.960+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:26.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46405 11.88 MB/sec execute 69 sec latency 140.267 ms 2022-09-17T10:44:26.940 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:26.936+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:27.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46475 11.74 MB/sec execute 70 sec latency 102.363 ms 2022-09-17T10:44:27.964 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:27.961+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:28.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46550 11.60 MB/sec execute 71 sec latency 141.624 ms 2022-09-17T10:44:28.949 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:28.945+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:29.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46635 11.45 MB/sec execute 72 sec latency 96.567 ms 2022-09-17T10:44:29.969 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:29.967+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:30.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46688 11.29 MB/sec execute 73 sec latency 376.285 ms 2022-09-17T10:44:30.996 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:30.992+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:31.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46713 11.14 MB/sec execute 74 sec latency 960.316 ms 2022-09-17T10:44:32.050 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:32.046+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:32.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46822 11.02 MB/sec execute 75 sec latency 339.848 ms 2022-09-17T10:44:33.047 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:33.044+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:33.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 46956 10.92 MB/sec execute 76 sec latency 232.564 ms 2022-09-17T10:44:34.084 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:34.078+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:34.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 47124 10.85 MB/sec execute 77 sec latency 111.551 ms 2022-09-17T10:44:35.053 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:35.051+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:35.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 47321 10.89 MB/sec execute 78 sec latency 195.539 ms 2022-09-17T10:44:36.032 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:36.028+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:36.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 47546 10.93 MB/sec execute 79 sec latency 142.334 ms 2022-09-17T10:44:37.071 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:37.067+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:37.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 47824 10.94 MB/sec execute 80 sec latency 146.740 ms 2022-09-17T10:44:38.114 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:38.110+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:38.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 48164 10.92 MB/sec execute 81 sec latency 183.656 ms 2022-09-17T10:44:39.185 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:39.154+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:39.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 48506 10.91 MB/sec execute 82 sec latency 122.336 ms 2022-09-17T10:44:40.209 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:40.205+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:40.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 48669 10.88 MB/sec execute 83 sec latency 306.979 ms 2022-09-17T10:44:41.186 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:41.182+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:41.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 48880 11.00 MB/sec execute 84 sec latency 310.259 ms 2022-09-17T10:44:42.140 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:42.136+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:42.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 49178 11.16 MB/sec execute 85 sec latency 93.626 ms 2022-09-17T10:44:43.131 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:43.127+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:43.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 49449 11.31 MB/sec execute 86 sec latency 112.249 ms 2022-09-17T10:44:44.189 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:44.186+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:44.350 INFO:tasks.workunit.client.0.smithi062.stdout: 10 49662 11.39 MB/sec execute 87 sec latency 95.231 ms 2022-09-17T10:44:45.237 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:45.212+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:45.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 49812 11.38 MB/sec execute 88 sec latency 154.456 ms 2022-09-17T10:44:46.234 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:46.232+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:46.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 49932 11.37 MB/sec execute 89 sec latency 142.128 ms 2022-09-17T10:44:47.231 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:47.227+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:47.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 50015 11.27 MB/sec execute 90 sec latency 90.142 ms 2022-09-17T10:44:48.267 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:48.265+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:48.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 50098 11.16 MB/sec execute 91 sec latency 102.800 ms 2022-09-17T10:44:49.250 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:49.247+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:49.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 50192 11.04 MB/sec execute 92 sec latency 102.974 ms 2022-09-17T10:44:50.257 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:50.254+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:50.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 50309 10.93 MB/sec execute 93 sec latency 153.662 ms 2022-09-17T10:44:51.243 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:51.241+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:51.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 50331 10.82 MB/sec execute 94 sec latency 867.174 ms 2022-09-17T10:44:52.292 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:52.288+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:52.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 50450 10.73 MB/sec execute 95 sec latency 614.159 ms 2022-09-17T10:44:53.323 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:53.301+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:53.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 50659 10.69 MB/sec execute 96 sec latency 98.281 ms 2022-09-17T10:44:54.319 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:54.316+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:54.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 50926 10.74 MB/sec execute 97 sec latency 92.107 ms 2022-09-17T10:44:55.282 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:55.278+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:55.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 51250 10.89 MB/sec execute 98 sec latency 93.417 ms 2022-09-17T10:44:56.264 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:56.260+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:56.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 51740 10.84 MB/sec execute 99 sec latency 130.521 ms 2022-09-17T10:44:57.258 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:57.254+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:57.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 52142 10.88 MB/sec execute 100 sec latency 86.732 ms 2022-09-17T10:44:58.264 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:58.261+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:58.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 52487 11.15 MB/sec execute 101 sec latency 70.846 ms 2022-09-17T10:44:59.249 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:44:59.245+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:44:59.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 52890 11.27 MB/sec execute 102 sec latency 61.863 ms 2022-09-17T10:45:00.291 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:00.287+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:00.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 53237 11.53 MB/sec execute 103 sec latency 73.312 ms 2022-09-17T10:45:01.253 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:01.249+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:01.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 53442 11.54 MB/sec execute 104 sec latency 74.126 ms 2022-09-17T10:45:02.250 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:02.248+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:02.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 53544 11.47 MB/sec execute 105 sec latency 93.782 ms 2022-09-17T10:45:03.207 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:03.204+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:03.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 53663 11.38 MB/sec execute 106 sec latency 74.794 ms 2022-09-17T10:45:04.240 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:04.238+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:04.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 53814 11.28 MB/sec execute 107 sec latency 105.368 ms 2022-09-17T10:45:05.280 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:05.265+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:05.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 54001 11.21 MB/sec execute 108 sec latency 328.469 ms 2022-09-17T10:45:06.281 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:06.277+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:06.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 54096 11.13 MB/sec execute 109 sec latency 568.235 ms 2022-09-17T10:45:07.312 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:07.308+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:07.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 54320 11.15 MB/sec execute 110 sec latency 785.194 ms 2022-09-17T10:45:08.278 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:08.265+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:08.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 54632 11.23 MB/sec execute 111 sec latency 73.370 ms 2022-09-17T10:45:09.270 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:09.268+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:09.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 54975 11.26 MB/sec execute 112 sec latency 114.598 ms 2022-09-17T10:45:10.242 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:10.239+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:10.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 55548 11.27 MB/sec execute 113 sec latency 71.623 ms 2022-09-17T10:45:11.216 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:11.214+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:11.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 55762 11.30 MB/sec execute 114 sec latency 202.830 ms 2022-09-17T10:45:12.173 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:12.169+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:12.351 INFO:tasks.workunit.client.0.smithi062.stdout: 10 56177 11.54 MB/sec execute 115 sec latency 74.396 ms 2022-09-17T10:45:13.171 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:13.168+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:13.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 56470 11.59 MB/sec execute 116 sec latency 107.686 ms 2022-09-17T10:45:14.154 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:14.150+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:14.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 56729 11.72 MB/sec execute 117 sec latency 99.008 ms 2022-09-17T10:45:15.126 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:15.123+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:15.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 56912 11.75 MB/sec execute 118 sec latency 101.767 ms 2022-09-17T10:45:16.171 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:16.167+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:16.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 57024 11.71 MB/sec execute 119 sec latency 134.499 ms 2022-09-17T10:45:17.155 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:17.137+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:17.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 57101 11.63 MB/sec execute 120 sec latency 89.849 ms 2022-09-17T10:45:18.162 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:18.159+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:18.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 57195 11.55 MB/sec execute 121 sec latency 94.002 ms 2022-09-17T10:45:19.190 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:19.186+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:19.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 57287 11.46 MB/sec execute 122 sec latency 128.178 ms 2022-09-17T10:45:20.186 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:20.173+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:20.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 57423 11.38 MB/sec execute 123 sec latency 85.425 ms 2022-09-17T10:45:21.205 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:21.189+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:21.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 57602 11.33 MB/sec execute 124 sec latency 138.043 ms 2022-09-17T10:45:22.159 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:22.155+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:22.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 57871 11.33 MB/sec execute 125 sec latency 108.987 ms 2022-09-17T10:45:23.136 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:23.133+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:23.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 58160 11.32 MB/sec execute 126 sec latency 94.388 ms 2022-09-17T10:45:24.173 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:24.157+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:24.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 58502 11.44 MB/sec execute 127 sec latency 98.771 ms 2022-09-17T10:45:25.163 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:25.160+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:25.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 58888 11.42 MB/sec execute 128 sec latency 98.764 ms 2022-09-17T10:45:26.195 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:26.191+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:26.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 59301 11.46 MB/sec execute 129 sec latency 104.338 ms 2022-09-17T10:45:27.157 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:27.154+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:27.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 59563 11.57 MB/sec execute 130 sec latency 80.512 ms 2022-09-17T10:45:28.184 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:28.181+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:28.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 59861 11.69 MB/sec execute 131 sec latency 81.586 ms 2022-09-17T10:45:29.240 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:29.236+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:29.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 60156 11.72 MB/sec execute 132 sec latency 88.601 ms 2022-09-17T10:45:30.264 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:30.261+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:30.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 60381 11.81 MB/sec execute 133 sec latency 126.249 ms 2022-09-17T10:45:31.242 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:31.239+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:31.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 60517 11.80 MB/sec execute 134 sec latency 99.239 ms 2022-09-17T10:45:32.218 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:32.215+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:32.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 60608 11.74 MB/sec execute 135 sec latency 106.560 ms 2022-09-17T10:45:33.174 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:33.171+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:33.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 60692 11.68 MB/sec execute 136 sec latency 109.989 ms 2022-09-17T10:45:34.194 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:34.190+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:34.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 60777 11.60 MB/sec execute 137 sec latency 108.116 ms 2022-09-17T10:45:35.247 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:35.244+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:35.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 60883 11.52 MB/sec execute 138 sec latency 126.418 ms 2022-09-17T10:45:36.228 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:36.226+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:36.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 61008 11.46 MB/sec execute 139 sec latency 92.832 ms 2022-09-17T10:45:37.283 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:37.260+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:37.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 61166 11.40 MB/sec execute 140 sec latency 113.856 ms 2022-09-17T10:45:38.245 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:38.222+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:38.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 61370 11.38 MB/sec execute 141 sec latency 93.933 ms 2022-09-17T10:45:39.203 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:39.200+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:39.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 61616 11.39 MB/sec execute 142 sec latency 98.206 ms 2022-09-17T10:45:40.246 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:40.243+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:40.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 61898 11.42 MB/sec execute 143 sec latency 103.331 ms 2022-09-17T10:45:41.272 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:41.268+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:41.352 INFO:tasks.workunit.client.0.smithi062.stdout: 10 62217 11.44 MB/sec execute 144 sec latency 102.873 ms 2022-09-17T10:45:42.312 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:42.288+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:42.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 62328 11.37 MB/sec execute 145 sec latency 528.915 ms 2022-09-17T10:45:43.296 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:43.292+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:43.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 62711 11.39 MB/sec execute 146 sec latency 189.250 ms 2022-09-17T10:45:44.317 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:44.314+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:44.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 62978 11.44 MB/sec execute 147 sec latency 86.754 ms 2022-09-17T10:45:45.273 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:45.270+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:45.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 63313 11.56 MB/sec execute 148 sec latency 77.658 ms 2022-09-17T10:45:46.332 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:46.329+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:46.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 63622 11.65 MB/sec execute 149 sec latency 120.041 ms 2022-09-17T10:45:47.292 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:47.288+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:47.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 63755 11.64 MB/sec execute 150 sec latency 576.683 ms 2022-09-17T10:45:48.325 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:48.322+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:48.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 63761 11.57 MB/sec execute 151 sec latency 1253.591 ms 2022-09-17T10:45:49.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 63937 11.59 MB/sec execute 152 sec latency 1269.151 ms 2022-09-17T10:45:49.391 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:49.388+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:50.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 64093 11.60 MB/sec execute 153 sec latency 130.007 ms 2022-09-17T10:45:50.365 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:50.363+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:51.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 64189 11.55 MB/sec execute 154 sec latency 132.450 ms 2022-09-17T10:45:51.417 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:51.413+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:52.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 64296 11.48 MB/sec execute 155 sec latency 111.119 ms 2022-09-17T10:45:52.421 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:52.416+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:53.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 64403 11.42 MB/sec execute 156 sec latency 110.024 ms 2022-09-17T10:45:53.452 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:53.448+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:54.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 64542 11.35 MB/sec execute 157 sec latency 133.419 ms 2022-09-17T10:45:54.497 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:54.495+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:55.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 64793 11.33 MB/sec execute 158 sec latency 82.046 ms 2022-09-17T10:45:55.472 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:55.457+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:56.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 65081 11.37 MB/sec execute 159 sec latency 137.279 ms 2022-09-17T10:45:56.505 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:56.490+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:57.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 65427 11.42 MB/sec execute 160 sec latency 139.536 ms 2022-09-17T10:45:57.512 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:57.508+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:58.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 65767 11.42 MB/sec execute 161 sec latency 83.898 ms 2022-09-17T10:45:58.538 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:58.534+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:45:59.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 66232 11.46 MB/sec execute 162 sec latency 87.036 ms 2022-09-17T10:45:59.554 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:45:59.538+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:00.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 66524 11.48 MB/sec execute 163 sec latency 73.356 ms 2022-09-17T10:46:00.504 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:00.490+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:01.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 66862 11.61 MB/sec execute 164 sec latency 76.739 ms 2022-09-17T10:46:01.548 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:01.544+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:02.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 67155 11.67 MB/sec execute 165 sec latency 94.762 ms 2022-09-17T10:46:02.548 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:02.545+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:03.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 67376 11.73 MB/sec execute 166 sec latency 179.271 ms 2022-09-17T10:46:03.594 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:03.576+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:04.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 67560 11.73 MB/sec execute 167 sec latency 81.861 ms 2022-09-17T10:46:04.548 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:04.530+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:05.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 67684 11.71 MB/sec execute 168 sec latency 77.034 ms 2022-09-17T10:46:05.525 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:05.522+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:06.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 67785 11.66 MB/sec execute 169 sec latency 83.778 ms 2022-09-17T10:46:06.486 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:06.473+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:07.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 67866 11.60 MB/sec execute 170 sec latency 210.047 ms 2022-09-17T10:46:07.513 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:07.493+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:08.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 67895 11.53 MB/sec execute 171 sec latency 612.261 ms 2022-09-17T10:46:08.486 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:08.474+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:09.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 67994 11.47 MB/sec execute 172 sec latency 653.321 ms 2022-09-17T10:46:09.486 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:09.484+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:10.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 68115 11.41 MB/sec execute 173 sec latency 183.494 ms 2022-09-17T10:46:10.507 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:10.505+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:11.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 68284 11.38 MB/sec execute 174 sec latency 246.847 ms 2022-09-17T10:46:11.513 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:11.509+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:12.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 68484 11.38 MB/sec execute 175 sec latency 112.630 ms 2022-09-17T10:46:12.566 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:12.563+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:13.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 68647 11.36 MB/sec execute 176 sec latency 186.251 ms 2022-09-17T10:46:13.576 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:13.575+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:14.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 68874 11.32 MB/sec execute 177 sec latency 223.325 ms 2022-09-17T10:46:14.646 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:14.618+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:15.353 INFO:tasks.workunit.client.0.smithi062.stdout: 10 69172 11.39 MB/sec execute 178 sec latency 99.489 ms 2022-09-17T10:46:15.632 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:15.629+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:16.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 69371 11.34 MB/sec execute 179 sec latency 103.817 ms 2022-09-17T10:46:16.652 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:16.643+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:17.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 69746 11.33 MB/sec execute 180 sec latency 428.324 ms 2022-09-17T10:46:17.601 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:17.598+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:18.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 69984 11.37 MB/sec execute 181 sec latency 109.686 ms 2022-09-17T10:46:18.557 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:18.554+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:19.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 70103 11.34 MB/sec execute 182 sec latency 115.458 ms 2022-09-17T10:46:19.566 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:19.563+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:20.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 70354 11.43 MB/sec execute 183 sec latency 150.548 ms 2022-09-17T10:46:20.630 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:20.628+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:21.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 70564 11.47 MB/sec execute 184 sec latency 102.696 ms 2022-09-17T10:46:21.659 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:21.653+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:22.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 70759 11.46 MB/sec execute 185 sec latency 203.451 ms 2022-09-17T10:46:22.629 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:22.625+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:23.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 70901 11.45 MB/sec execute 186 sec latency 229.321 ms 2022-09-17T10:46:23.617 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:23.614+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:24.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71033 11.50 MB/sec execute 187 sec latency 190.018 ms 2022-09-17T10:46:24.660 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:24.656+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:25.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71117 11.45 MB/sec execute 188 sec latency 165.916 ms 2022-09-17T10:46:25.615 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:25.614+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:26.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71207 11.42 MB/sec execute 189 sec latency 146.029 ms 2022-09-17T10:46:26.658 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:26.631+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:27.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71276 11.37 MB/sec execute 190 sec latency 159.566 ms 2022-09-17T10:46:27.617 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:27.612+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:28.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71304 11.31 MB/sec execute 191 sec latency 489.341 ms 2022-09-17T10:46:28.618 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:28.616+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:29.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71334 11.25 MB/sec execute 192 sec latency 847.123 ms 2022-09-17T10:46:29.654 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:29.626+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:30.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71428 11.21 MB/sec execute 193 sec latency 557.878 ms 2022-09-17T10:46:30.614 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:30.612+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:31.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71522 11.16 MB/sec execute 194 sec latency 183.367 ms 2022-09-17T10:46:31.618 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:31.616+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:32.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71656 11.12 MB/sec execute 195 sec latency 85.738 ms 2022-09-17T10:46:32.579 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:32.576+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:33.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71728 11.06 MB/sec execute 196 sec latency 404.370 ms 2022-09-17T10:46:33.585 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:33.580+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:34.354 INFO:tasks.workunit.client.0.smithi062.stdout: 10 71898 11.05 MB/sec execute 197 sec latency 314.659 ms 2022-09-17T10:46:34.581 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:34.579+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:35.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 72093 11.03 MB/sec execute 198 sec latency 129.628 ms 2022-09-17T10:46:35.572 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:35.569+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:36.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 72372 11.03 MB/sec execute 199 sec latency 170.490 ms 2022-09-17T10:46:36.586 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:36.558+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:37.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 72655 11.07 MB/sec execute 200 sec latency 103.484 ms 2022-09-17T10:46:37.581 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:37.579+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:38.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 72918 11.09 MB/sec execute 201 sec latency 111.188 ms 2022-09-17T10:46:38.533 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:38.530+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:39.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 73397 11.10 MB/sec execute 202 sec latency 316.496 ms 2022-09-17T10:46:39.588 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:39.586+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:40.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 73689 11.12 MB/sec execute 203 sec latency 83.476 ms 2022-09-17T10:46:40.561 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:40.559+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:41.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 73913 11.17 MB/sec execute 204 sec latency 226.893 ms 2022-09-17T10:46:41.541 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:41.539+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:42.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 74243 11.26 MB/sec execute 205 sec latency 120.353 ms 2022-09-17T10:46:42.509 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:42.508+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:43.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 74436 11.25 MB/sec execute 206 sec latency 392.625 ms 2022-09-17T10:46:43.484 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:43.482+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:44.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 74611 11.27 MB/sec execute 207 sec latency 453.022 ms 2022-09-17T10:46:44.489 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:44.488+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:45.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 74801 11.29 MB/sec execute 208 sec latency 89.850 ms 2022-09-17T10:46:45.517 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:45.513+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:46.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 74928 11.26 MB/sec execute 209 sec latency 138.028 ms 2022-09-17T10:46:46.517 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:46.514+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:47.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 75061 11.22 MB/sec execute 210 sec latency 106.972 ms 2022-09-17T10:46:47.498 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:47.493+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:48.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 75206 11.18 MB/sec execute 211 sec latency 83.352 ms 2022-09-17T10:46:48.533 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:48.531+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:49.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 75380 11.15 MB/sec execute 212 sec latency 93.034 ms 2022-09-17T10:46:49.514 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:49.486+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:50.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 75624 11.15 MB/sec execute 213 sec latency 122.997 ms 2022-09-17T10:46:50.497 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:50.494+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:51.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 75876 11.14 MB/sec execute 214 sec latency 108.681 ms 2022-09-17T10:46:51.515 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:51.513+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:52.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 76183 11.15 MB/sec execute 215 sec latency 103.891 ms 2022-09-17T10:46:52.488 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:52.486+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:53.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 76456 11.20 MB/sec execute 216 sec latency 125.489 ms 2022-09-17T10:46:53.520 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:53.519+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:54.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 76832 11.20 MB/sec execute 217 sec latency 120.394 ms 2022-09-17T10:46:54.552 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:54.549+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:55.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 77187 11.23 MB/sec execute 218 sec latency 86.585 ms 2022-09-17T10:46:55.544 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:55.543+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:56.355 INFO:tasks.workunit.client.0.smithi062.stdout: 10 77399 11.23 MB/sec execute 219 sec latency 89.544 ms 2022-09-17T10:46:56.503 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:56.501+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:57.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 77681 11.32 MB/sec execute 220 sec latency 96.749 ms 2022-09-17T10:46:57.475 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:57.474+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:58.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 77909 11.33 MB/sec execute 221 sec latency 99.587 ms 2022-09-17T10:46:58.529 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:58.527+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:46:59.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 78125 11.36 MB/sec execute 222 sec latency 121.891 ms 2022-09-17T10:46:59.556 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:46:59.552+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:00.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 78297 11.38 MB/sec execute 223 sec latency 73.641 ms 2022-09-17T10:47:00.532 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:00.531+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:01.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 78402 11.35 MB/sec execute 224 sec latency 133.780 ms 2022-09-17T10:47:01.524 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:01.523+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:02.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 78526 11.31 MB/sec execute 225 sec latency 105.496 ms 2022-09-17T10:47:02.536 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:02.535+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:03.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 78661 11.28 MB/sec execute 226 sec latency 110.647 ms 2022-09-17T10:47:03.557 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:03.545+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:04.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 78686 11.23 MB/sec execute 227 sec latency 732.663 ms 2022-09-17T10:47:04.500 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:04.499+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:05.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 78788 11.19 MB/sec execute 228 sec latency 649.794 ms 2022-09-17T10:47:05.508 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:05.506+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:06.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 78930 11.16 MB/sec execute 229 sec latency 286.149 ms 2022-09-17T10:47:06.530 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:06.525+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:07.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 79195 11.15 MB/sec execute 230 sec latency 139.014 ms 2022-09-17T10:47:07.557 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:07.555+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:08.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 79509 11.18 MB/sec execute 231 sec latency 109.112 ms 2022-09-17T10:47:08.588 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:08.587+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:09.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 79828 11.20 MB/sec execute 232 sec latency 169.526 ms 2022-09-17T10:47:09.553 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:09.552+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:10.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 80204 11.22 MB/sec execute 233 sec latency 94.253 ms 2022-09-17T10:47:10.560 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:10.559+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:11.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 80708 11.27 MB/sec execute 234 sec latency 63.033 ms 2022-09-17T10:47:11.577 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:11.576+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:12.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 81000 11.32 MB/sec execute 235 sec latency 68.444 ms 2022-09-17T10:47:12.614 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:12.612+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:13.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 81348 11.40 MB/sec execute 236 sec latency 74.482 ms 2022-09-17T10:47:13.672 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:13.670+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:14.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 81626 11.43 MB/sec execute 237 sec latency 91.187 ms 2022-09-17T10:47:14.695 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:14.694+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:15.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 81818 11.46 MB/sec execute 238 sec latency 103.644 ms 2022-09-17T10:47:15.750 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:15.749+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:16.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 81939 11.44 MB/sec execute 239 sec latency 92.334 ms 2022-09-17T10:47:16.704 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:16.703+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:17.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 82049 11.40 MB/sec execute 240 sec latency 122.778 ms 2022-09-17T10:47:17.659 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:17.658+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:18.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 82166 11.36 MB/sec execute 241 sec latency 91.038 ms 2022-09-17T10:47:18.658 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:18.657+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:19.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 82292 11.33 MB/sec execute 242 sec latency 90.191 ms 2022-09-17T10:47:19.623 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:19.621+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:20.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 82409 11.29 MB/sec execute 243 sec latency 247.239 ms 2022-09-17T10:47:20.603 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:20.599+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:21.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 82582 11.28 MB/sec execute 244 sec latency 223.524 ms 2022-09-17T10:47:21.693 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:21.690+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:22.356 INFO:tasks.workunit.client.0.smithi062.stdout: 10 82795 11.26 MB/sec execute 245 sec latency 181.799 ms 2022-09-17T10:47:22.732 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:22.730+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:23.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 83045 11.25 MB/sec execute 246 sec latency 170.315 ms 2022-09-17T10:47:23.719 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:23.715+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:24.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 83210 11.27 MB/sec execute 247 sec latency 414.502 ms 2022-09-17T10:47:24.785 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:24.746+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:25.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 83214 11.22 MB/sec execute 248 sec latency 1128.149 ms 2022-09-17T10:47:25.790 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:25.788+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:26.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 83306 11.20 MB/sec execute 249 sec latency 1227.073 ms 2022-09-17T10:47:26.755 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:26.753+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:27.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 83527 11.18 MB/sec execute 250 sec latency 126.934 ms 2022-09-17T10:47:27.770 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:27.769+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:28.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 83909 11.19 MB/sec execute 251 sec latency 123.993 ms 2022-09-17T10:47:28.810 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:28.801+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:29.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 84189 11.19 MB/sec execute 252 sec latency 86.803 ms 2022-09-17T10:47:29.772 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:29.770+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:30.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 84421 11.22 MB/sec execute 253 sec latency 83.188 ms 2022-09-17T10:47:30.739 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:30.737+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:31.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 84712 11.30 MB/sec execute 254 sec latency 102.812 ms 2022-09-17T10:47:31.767 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:31.764+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:32.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 84982 11.32 MB/sec execute 255 sec latency 115.427 ms 2022-09-17T10:47:32.739 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:32.721+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:33.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 85197 11.35 MB/sec execute 256 sec latency 131.433 ms 2022-09-17T10:47:33.720 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:33.718+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:34.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 85368 11.36 MB/sec execute 257 sec latency 79.973 ms 2022-09-17T10:47:34.678 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:34.677+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:35.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 85475 11.34 MB/sec execute 258 sec latency 110.324 ms 2022-09-17T10:47:35.668 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:35.667+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:36.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 85579 11.30 MB/sec execute 259 sec latency 92.751 ms 2022-09-17T10:47:36.684 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:36.676+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:37.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 85710 11.27 MB/sec execute 260 sec latency 102.706 ms 2022-09-17T10:47:37.698 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:37.695+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:38.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 85856 11.23 MB/sec execute 261 sec latency 129.306 ms 2022-09-17T10:47:38.672 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:38.669+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:39.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 86065 11.21 MB/sec execute 262 sec latency 379.660 ms 2022-09-17T10:47:39.674 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:39.671+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:40.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 86364 11.23 MB/sec execute 263 sec latency 91.079 ms 2022-09-17T10:47:40.677 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:40.676+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:41.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 86735 11.27 MB/sec execute 264 sec latency 87.864 ms 2022-09-17T10:47:41.647 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:41.644+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:42.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 86948 11.26 MB/sec execute 265 sec latency 298.442 ms 2022-09-17T10:47:42.642 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:42.638+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:43.357 INFO:tasks.workunit.client.0.smithi062.stdout: 10 87195 11.23 MB/sec execute 266 sec latency 143.470 ms 2022-09-17T10:47:43.635 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:43.632+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:44.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 87574 11.23 MB/sec execute 267 sec latency 138.951 ms 2022-09-17T10:47:44.623 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:44.615+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:45.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 87799 11.26 MB/sec execute 268 sec latency 123.329 ms 2022-09-17T10:47:45.607 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:45.605+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:46.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 88089 11.31 MB/sec execute 269 sec latency 97.968 ms 2022-09-17T10:47:46.595 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:46.593+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:47.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 88386 11.37 MB/sec execute 270 sec latency 104.228 ms 2022-09-17T10:47:47.636 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:47.634+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:48.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 88604 11.38 MB/sec execute 271 sec latency 213.243 ms 2022-09-17T10:47:48.689 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:48.687+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:49.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 88812 11.41 MB/sec execute 272 sec latency 146.343 ms 2022-09-17T10:47:49.715 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:49.707+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:50.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 88846 11.37 MB/sec execute 273 sec latency 559.214 ms 2022-09-17T10:47:50.693 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:50.689+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:51.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 88905 11.35 MB/sec execute 274 sec latency 888.456 ms 2022-09-17T10:47:51.661 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:51.658+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:52.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 89023 11.33 MB/sec execute 275 sec latency 99.446 ms 2022-09-17T10:47:52.636 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:52.610+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:53.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 89120 11.30 MB/sec execute 276 sec latency 145.912 ms 2022-09-17T10:47:53.652 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:53.650+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:54.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 89232 11.26 MB/sec execute 277 sec latency 146.455 ms 2022-09-17T10:47:54.682 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:54.681+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:55.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 89380 11.23 MB/sec execute 278 sec latency 155.382 ms 2022-09-17T10:47:55.682 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:55.679+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:56.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 89551 11.21 MB/sec execute 279 sec latency 138.672 ms 2022-09-17T10:47:56.708 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:56.703+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:57.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 89801 11.22 MB/sec execute 280 sec latency 158.738 ms 2022-09-17T10:47:57.735 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:57.733+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:58.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 90071 11.21 MB/sec execute 281 sec latency 184.375 ms 2022-09-17T10:47:58.755 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:58.753+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:47:59.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 90418 11.25 MB/sec execute 282 sec latency 164.312 ms 2022-09-17T10:47:59.797 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:47:59.796+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:00.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 90711 11.24 MB/sec execute 283 sec latency 99.927 ms 2022-09-17T10:48:00.775 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:00.773+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:01.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 91169 11.27 MB/sec execute 284 sec latency 81.400 ms 2022-09-17T10:48:01.774 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:01.769+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:02.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 91398 11.27 MB/sec execute 285 sec latency 89.629 ms 2022-09-17T10:48:02.794 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:02.791+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:03.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 91693 11.33 MB/sec execute 286 sec latency 121.517 ms 2022-09-17T10:48:03.859 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:03.836+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:04.358 INFO:tasks.workunit.client.0.smithi062.stdout: 10 91936 11.37 MB/sec execute 287 sec latency 164.113 ms 2022-09-17T10:48:04.858 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:04.856+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:05.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 92074 11.34 MB/sec execute 288 sec latency 348.410 ms 2022-09-17T10:48:05.821 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:05.819+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:06.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 92153 11.34 MB/sec execute 289 sec latency 518.984 ms 2022-09-17T10:48:06.846 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:06.842+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:07.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 92353 11.36 MB/sec execute 290 sec latency 143.176 ms 2022-09-17T10:48:07.912 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:07.886+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:08.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 92490 11.35 MB/sec execute 291 sec latency 158.560 ms 2022-09-17T10:48:08.909 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:08.907+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:09.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 92592 11.33 MB/sec execute 292 sec latency 132.734 ms 2022-09-17T10:48:09.920 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:09.917+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:10.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 92695 11.30 MB/sec execute 293 sec latency 138.069 ms 2022-09-17T10:48:10.921 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:10.918+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:11.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 92802 11.26 MB/sec execute 294 sec latency 132.695 ms 2022-09-17T10:48:11.925 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:11.923+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:12.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 92953 11.23 MB/sec execute 295 sec latency 98.514 ms 2022-09-17T10:48:12.940 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:12.939+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:13.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 93131 11.22 MB/sec execute 296 sec latency 85.402 ms 2022-09-17T10:48:13.929 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:13.905+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:14.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 93402 11.22 MB/sec execute 297 sec latency 100.402 ms 2022-09-17T10:48:14.910 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:14.908+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:15.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 93674 11.22 MB/sec execute 298 sec latency 218.611 ms 2022-09-17T10:48:15.949 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:15.947+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:16.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 94018 11.26 MB/sec execute 299 sec latency 127.671 ms 2022-09-17T10:48:16.924 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:16.922+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:17.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 94419 11.28 MB/sec execute 300 sec latency 77.067 ms 2022-09-17T10:48:17.927 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:17.927+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:18.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 94932 11.31 MB/sec execute 301 sec latency 74.741 ms 2022-09-17T10:48:18.939 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:18.937+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 95215 11.36 MB/sec execute 302 sec latency 74.778 ms 2022-09-17T10:48:19.910 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:19.907+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:20.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 95528 11.41 MB/sec execute 303 sec latency 110.756 ms 2022-09-17T10:48:20.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:20.863+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:21.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 95814 11.43 MB/sec execute 304 sec latency 81.307 ms 2022-09-17T10:48:21.884 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:21.883+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:22.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 96033 11.46 MB/sec execute 305 sec latency 80.102 ms 2022-09-17T10:48:22.881 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:22.867+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:23.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 96178 11.44 MB/sec execute 306 sec latency 119.785 ms 2022-09-17T10:48:23.857 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:23.839+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:24.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 96317 11.41 MB/sec execute 307 sec latency 114.429 ms 2022-09-17T10:48:24.890 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:24.878+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:25.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 96468 11.39 MB/sec execute 308 sec latency 91.644 ms 2022-09-17T10:48:25.915 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:25.913+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:26.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 96482 11.35 MB/sec execute 309 sec latency 593.445 ms 2022-09-17T10:48:26.953 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:26.951+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:27.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 96661 11.34 MB/sec execute 310 sec latency 545.814 ms 2022-09-17T10:48:27.979 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:27.977+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:28.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 96868 11.32 MB/sec execute 311 sec latency 210.880 ms 2022-09-17T10:48:28.957 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:28.954+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:29.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 97213 11.32 MB/sec execute 312 sec latency 86.993 ms 2022-09-17T10:48:29.933 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:29.918+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:30.359 INFO:tasks.workunit.client.0.smithi062.stdout: 10 97529 11.34 MB/sec execute 313 sec latency 84.906 ms 2022-09-17T10:48:30.891 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:30.889+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:31.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 97924 11.38 MB/sec execute 314 sec latency 80.090 ms 2022-09-17T10:48:31.939 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:31.936+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:32.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 98307 11.38 MB/sec execute 315 sec latency 159.062 ms 2022-09-17T10:48:32.958 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:32.955+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:33.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 98618 11.42 MB/sec execute 316 sec latency 184.757 ms 2022-09-17T10:48:33.953 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:33.950+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:34.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 98855 11.44 MB/sec execute 317 sec latency 87.882 ms 2022-09-17T10:48:34.976 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:34.973+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:35.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 99103 11.48 MB/sec execute 318 sec latency 273.004 ms 2022-09-17T10:48:36.011 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:35.992+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:36.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 99337 11.48 MB/sec execute 319 sec latency 79.156 ms 2022-09-17T10:48:36.959 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:36.957+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:37.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 99529 11.50 MB/sec execute 320 sec latency 100.584 ms 2022-09-17T10:48:37.982 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:37.980+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:38.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 99669 11.49 MB/sec execute 321 sec latency 136.539 ms 2022-09-17T10:48:38.976 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:38.972+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:39.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 99792 11.47 MB/sec execute 322 sec latency 79.372 ms 2022-09-17T10:48:39.964 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:39.963+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:40.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 99933 11.44 MB/sec execute 323 sec latency 89.977 ms 2022-09-17T10:48:40.976 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:40.970+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:41.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 99990 11.41 MB/sec execute 324 sec latency 490.912 ms 2022-09-17T10:48:41.979 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:41.977+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:42.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 100102 11.39 MB/sec execute 325 sec latency 647.379 ms 2022-09-17T10:48:42.962 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:42.959+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:43.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 100259 11.37 MB/sec execute 326 sec latency 152.445 ms 2022-09-17T10:48:43.958 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:43.955+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:44.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 100475 11.36 MB/sec execute 327 sec latency 155.821 ms 2022-09-17T10:48:44.983 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:44.982+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:45.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 100767 11.36 MB/sec execute 328 sec latency 100.104 ms 2022-09-17T10:48:45.948 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:45.946+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:46.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 101014 11.36 MB/sec execute 329 sec latency 101.761 ms 2022-09-17T10:48:46.975 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:46.969+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:47.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 101342 11.38 MB/sec execute 330 sec latency 89.182 ms 2022-09-17T10:48:47.944 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:47.942+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:48.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 101698 11.40 MB/sec execute 331 sec latency 139.835 ms 2022-09-17T10:48:48.919 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:48.907+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:49.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 102107 11.42 MB/sec execute 332 sec latency 68.569 ms 2022-09-17T10:48:49.887 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:49.885+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:50.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 102346 11.45 MB/sec execute 333 sec latency 75.270 ms 2022-09-17T10:48:50.879 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:50.876+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:51.360 INFO:tasks.workunit.client.0.smithi062.stdout: 10 102617 11.49 MB/sec execute 334 sec latency 72.515 ms 2022-09-17T10:48:51.828 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:51.827+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:52.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 102895 11.52 MB/sec execute 335 sec latency 68.558 ms 2022-09-17T10:48:52.782 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:52.780+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:53.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 103086 11.52 MB/sec execute 336 sec latency 77.405 ms 2022-09-17T10:48:53.782 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:53.781+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:54.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 103245 11.52 MB/sec execute 337 sec latency 122.814 ms 2022-09-17T10:48:54.772 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:54.770+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:55.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 103361 11.49 MB/sec execute 338 sec latency 263.208 ms 2022-09-17T10:48:55.798 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:55.796+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:56.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 103460 11.46 MB/sec execute 339 sec latency 253.371 ms 2022-09-17T10:48:56.831 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:56.829+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:57.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 103490 11.43 MB/sec execute 340 sec latency 596.109 ms 2022-09-17T10:48:57.803 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:57.790+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:58.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 103636 11.41 MB/sec execute 341 sec latency 280.437 ms 2022-09-17T10:48:58.762 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:58.760+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:48:59.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 103765 11.39 MB/sec execute 342 sec latency 226.448 ms 2022-09-17T10:48:59.779 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:48:59.777+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:00.361 INFO:tasks.workunit.client.0.smithi062.stdout: 10 103960 11.39 MB/sec execute 343 sec latency 176.892 ms 2022-09-17T10:49:00.779 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:00.777+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:01.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 104143 11.37 MB/sec execute 344 sec latency 191.382 ms 2022-09-17T10:49:01.842 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:01.840+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:02.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 104418 11.37 MB/sec execute 345 sec latency 137.427 ms 2022-09-17T10:49:02.821 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:02.819+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:03.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 104609 11.35 MB/sec execute 346 sec latency 167.349 ms 2022-09-17T10:49:03.853 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:03.850+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 104837 11.36 MB/sec execute 347 sec latency 171.139 ms 2022-09-17T10:49:04.896 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:04.893+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:05.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 105063 11.37 MB/sec execute 348 sec latency 118.542 ms 2022-09-17T10:49:05.935 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:05.933+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:06.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 105333 11.37 MB/sec execute 349 sec latency 107.197 ms 2022-09-17T10:49:06.950 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:06.946+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:07.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 105620 11.39 MB/sec execute 350 sec latency 100.461 ms 2022-09-17T10:49:07.952 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:07.950+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:08.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 105867 11.41 MB/sec execute 351 sec latency 97.367 ms 2022-09-17T10:49:08.989 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:08.987+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:09.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 106090 11.43 MB/sec execute 352 sec latency 136.910 ms 2022-09-17T10:49:10.051 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:10.048+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:10.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 106310 11.45 MB/sec execute 353 sec latency 84.592 ms 2022-09-17T10:49:11.058 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:11.056+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:11.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 106517 11.46 MB/sec execute 354 sec latency 80.661 ms 2022-09-17T10:49:12.102 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:12.100+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:12.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 106664 11.45 MB/sec execute 355 sec latency 103.140 ms 2022-09-17T10:49:13.128 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:13.127+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:13.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 106778 11.43 MB/sec execute 356 sec latency 125.864 ms 2022-09-17T10:49:14.121 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:14.119+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:14.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 106891 11.41 MB/sec execute 357 sec latency 107.102 ms 2022-09-17T10:49:15.163 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:15.162+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:15.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 107010 11.39 MB/sec execute 358 sec latency 121.251 ms 2022-09-17T10:49:16.126 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:16.124+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:16.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 107144 11.37 MB/sec execute 359 sec latency 88.991 ms 2022-09-17T10:49:17.137 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:17.135+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:17.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 107304 11.35 MB/sec execute 360 sec latency 79.863 ms 2022-09-17T10:49:18.190 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:18.188+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:18.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 107502 11.35 MB/sec execute 361 sec latency 86.302 ms 2022-09-17T10:49:19.182 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:19.159+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:19.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 107771 11.34 MB/sec execute 362 sec latency 100.905 ms 2022-09-17T10:49:20.218 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:20.215+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:20.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 108043 11.34 MB/sec execute 363 sec latency 94.231 ms 2022-09-17T10:49:21.264 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:21.264+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:21.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 108315 11.35 MB/sec execute 364 sec latency 107.932 ms 2022-09-17T10:49:22.322 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:22.315+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:22.375 INFO:tasks.workunit.client.0.smithi062.stdout: 10 108631 11.37 MB/sec execute 365 sec latency 92.785 ms 2022-09-17T10:49:23.328 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:23.326+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:23.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 108968 11.38 MB/sec execute 366 sec latency 112.385 ms 2022-09-17T10:49:24.345 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:24.343+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:24.362 INFO:tasks.workunit.client.0.smithi062.stdout: 10 109263 11.41 MB/sec execute 367 sec latency 97.334 ms 2022-09-17T10:49:25.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 109519 11.42 MB/sec execute 368 sec latency 87.286 ms 2022-09-17T10:49:25.394 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:25.392+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:26.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 109739 11.44 MB/sec execute 369 sec latency 126.716 ms 2022-09-17T10:49:26.363 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:26.361+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:27.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 109925 11.44 MB/sec execute 370 sec latency 168.328 ms 2022-09-17T10:49:27.397 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:27.377+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:28.356 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:28.356+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:28.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 110106 11.46 MB/sec execute 371 sec latency 85.029 ms 2022-09-17T10:49:29.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 110268 11.45 MB/sec execute 372 sec latency 207.042 ms 2022-09-17T10:49:29.401 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:29.399+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:30.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 110395 11.43 MB/sec execute 373 sec latency 181.780 ms 2022-09-17T10:49:30.385 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:30.381+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:31.361 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:31.361+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:31.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 110525 11.41 MB/sec execute 374 sec latency 80.153 ms 2022-09-17T10:49:32.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 110617 11.39 MB/sec execute 375 sec latency 440.696 ms 2022-09-17T10:49:32.387 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:32.379+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:33.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 110624 11.36 MB/sec execute 376 sec latency 1228.822 ms 2022-09-17T10:49:33.366 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:33.364+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:34.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 110773 11.34 MB/sec execute 377 sec latency 1350.432 ms 2022-09-17T10:49:34.406 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:34.404+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:35.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 110950 11.33 MB/sec execute 378 sec latency 170.692 ms 2022-09-17T10:49:35.457 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:35.455+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:36.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 111183 11.33 MB/sec execute 379 sec latency 214.298 ms 2022-09-17T10:49:36.505 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:36.503+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:37.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 111534 11.33 MB/sec execute 380 sec latency 89.306 ms 2022-09-17T10:49:37.525 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:37.523+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:38.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 111819 11.33 MB/sec execute 381 sec latency 151.081 ms 2022-09-17T10:49:38.509 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:38.491+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:39.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 112156 11.36 MB/sec execute 382 sec latency 106.306 ms 2022-09-17T10:49:39.488 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:39.486+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:40.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 112585 11.39 MB/sec execute 383 sec latency 89.700 ms 2022-09-17T10:49:40.459 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:40.456+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:41.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 112925 11.41 MB/sec execute 384 sec latency 73.949 ms 2022-09-17T10:49:41.440 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:41.439+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:42.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 113143 11.43 MB/sec execute 385 sec latency 455.143 ms 2022-09-17T10:49:42.468 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:42.450+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:43.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 113408 11.46 MB/sec execute 386 sec latency 114.887 ms 2022-09-17T10:49:43.501 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:43.499+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:44.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 113599 11.46 MB/sec execute 387 sec latency 111.777 ms 2022-09-17T10:49:44.511 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:44.510+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:45.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 113761 11.46 MB/sec execute 388 sec latency 110.898 ms 2022-09-17T10:49:45.546 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:45.543+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:46.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 113877 11.45 MB/sec execute 389 sec latency 101.282 ms 2022-09-17T10:49:46.581 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:46.579+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:47.363 INFO:tasks.workunit.client.0.smithi062.stdout: 10 113958 11.43 MB/sec execute 390 sec latency 132.370 ms 2022-09-17T10:49:47.626 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:47.595+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:48.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 113969 11.40 MB/sec execute 391 sec latency 866.436 ms 2022-09-17T10:49:48.591 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:48.589+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:49.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114022 11.37 MB/sec execute 392 sec latency 1089.923 ms 2022-09-17T10:49:49.584 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:49.582+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:50.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114114 11.35 MB/sec execute 393 sec latency 147.221 ms 2022-09-17T10:49:50.631 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:50.629+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:51.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114175 11.32 MB/sec execute 394 sec latency 298.018 ms 2022-09-17T10:49:51.626 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:51.624+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:52.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114249 11.30 MB/sec execute 395 sec latency 225.799 ms 2022-09-17T10:49:52.603 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:52.601+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:53.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114332 11.28 MB/sec execute 396 sec latency 239.565 ms 2022-09-17T10:49:53.573 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:53.571+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:54.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114413 11.26 MB/sec execute 397 sec latency 232.162 ms 2022-09-17T10:49:54.566 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:54.563+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:55.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114518 11.25 MB/sec execute 398 sec latency 229.698 ms 2022-09-17T10:49:55.578 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:55.576+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:56.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114612 11.23 MB/sec execute 399 sec latency 392.188 ms 2022-09-17T10:49:56.628 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:56.595+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:57.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114777 11.21 MB/sec execute 400 sec latency 173.746 ms 2022-09-17T10:49:57.641 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:57.638+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:58.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 114992 11.20 MB/sec execute 401 sec latency 129.102 ms 2022-09-17T10:49:58.697 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:58.667+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:49:59.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 115213 11.19 MB/sec execute 402 sec latency 178.967 ms 2022-09-17T10:49:59.718 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:49:59.716+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:00.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 115408 11.19 MB/sec execute 403 sec latency 125.662 ms 2022-09-17T10:50:00.721 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:00.719+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:01.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 115635 11.21 MB/sec execute 404 sec latency 127.870 ms 2022-09-17T10:50:01.687 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:01.686+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:02.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 115906 11.22 MB/sec execute 405 sec latency 106.421 ms 2022-09-17T10:50:02.679 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:02.677+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:03.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 116265 11.23 MB/sec execute 406 sec latency 93.067 ms 2022-09-17T10:50:03.722 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:03.720+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 116518 11.24 MB/sec execute 407 sec latency 121.763 ms 2022-09-17T10:50:04.771 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:04.769+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:05.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 116761 11.27 MB/sec execute 408 sec latency 655.117 ms 2022-09-17T10:50:05.800 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:05.797+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:06.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 116948 11.28 MB/sec execute 409 sec latency 90.448 ms 2022-09-17T10:50:06.754 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:06.752+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:07.364 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117149 11.28 MB/sec execute 410 sec latency 88.670 ms 2022-09-17T10:50:07.749 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:07.747+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:08.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117309 11.29 MB/sec execute 411 sec latency 175.302 ms 2022-09-17T10:50:08.716 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:08.714+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:09.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117360 11.26 MB/sec execute 412 sec latency 207.064 ms 2022-09-17T10:50:09.714 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:09.712+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117445 11.25 MB/sec execute 413 sec latency 140.240 ms 2022-09-17T10:50:10.743 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:10.741+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:11.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117497 11.22 MB/sec execute 414 sec latency 273.657 ms 2022-09-17T10:50:11.811 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:11.806+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:12.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117583 11.20 MB/sec execute 415 sec latency 203.514 ms 2022-09-17T10:50:12.854 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:12.852+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:13.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117656 11.18 MB/sec execute 416 sec latency 398.817 ms 2022-09-17T10:50:13.874 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:13.872+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:14.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117669 11.16 MB/sec execute 417 sec latency 941.109 ms 2022-09-17T10:50:14.936 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:14.934+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:15.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117770 11.13 MB/sec execute 418 sec latency 322.584 ms 2022-09-17T10:50:15.938 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:15.936+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:16.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 117883 11.12 MB/sec execute 419 sec latency 233.905 ms 2022-09-17T10:50:16.919 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:16.917+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:17.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 118024 11.10 MB/sec execute 420 sec latency 134.029 ms 2022-09-17T10:50:17.956 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:17.952+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:18.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 118227 11.10 MB/sec execute 421 sec latency 146.397 ms 2022-09-17T10:50:19.002 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:18.981+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:19.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 118485 11.10 MB/sec execute 422 sec latency 176.066 ms 2022-09-17T10:50:19.985 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:19.983+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:20.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 118792 11.10 MB/sec execute 423 sec latency 92.266 ms 2022-09-17T10:50:20.997 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:20.995+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:21.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 119109 11.11 MB/sec execute 424 sec latency 90.690 ms 2022-09-17T10:50:21.997 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:21.995+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:22.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 119517 11.13 MB/sec execute 425 sec latency 86.290 ms 2022-09-17T10:50:22.980 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:22.978+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:23.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 119843 11.16 MB/sec execute 426 sec latency 89.715 ms 2022-09-17T10:50:24.024 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:24.022+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:24.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 120187 11.20 MB/sec execute 427 sec latency 176.646 ms 2022-09-17T10:50:25.058 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:25.056+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:25.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 120508 11.22 MB/sec execute 428 sec latency 65.757 ms 2022-09-17T10:50:26.045 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:26.043+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:26.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 120745 11.25 MB/sec execute 429 sec latency 85.945 ms 2022-09-17T10:50:27.014 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:27.014+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:27.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 120925 11.24 MB/sec execute 430 sec latency 69.464 ms 2022-09-17T10:50:27.991 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:27.990+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:28.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 121111 11.23 MB/sec execute 431 sec latency 107.782 ms 2022-09-17T10:50:28.979 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:28.978+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:29.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 121304 11.21 MB/sec execute 432 sec latency 128.098 ms 2022-09-17T10:50:30.009 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:30.007+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:30.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 121559 11.21 MB/sec execute 433 sec latency 87.785 ms 2022-09-17T10:50:30.979 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:30.968+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:31.365 INFO:tasks.workunit.client.0.smithi062.stdout: 10 121898 11.22 MB/sec execute 434 sec latency 70.687 ms 2022-09-17T10:50:31.996 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:31.994+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:32.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 122240 11.22 MB/sec execute 435 sec latency 99.449 ms 2022-09-17T10:50:32.964 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:32.951+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:33.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 122588 11.24 MB/sec execute 436 sec latency 499.165 ms 2022-09-17T10:50:33.983 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:33.981+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 122996 11.26 MB/sec execute 437 sec latency 547.449 ms 2022-09-17T10:50:34.939 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:34.936+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:35.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 123325 11.27 MB/sec execute 438 sec latency 76.687 ms 2022-09-17T10:50:35.975 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:35.957+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:36.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 123622 11.32 MB/sec execute 439 sec latency 111.440 ms 2022-09-17T10:50:37.003 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:36.986+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:37.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 123907 11.34 MB/sec execute 440 sec latency 106.420 ms 2022-09-17T10:50:38.008 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:37.988+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:38.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 124079 11.33 MB/sec execute 441 sec latency 220.773 ms 2022-09-17T10:50:38.992 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:38.981+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:39.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 124131 11.31 MB/sec execute 442 sec latency 764.094 ms 2022-09-17T10:50:39.987 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:39.986+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:40.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 124141 11.29 MB/sec execute 443 sec latency 853.088 ms 2022-09-17T10:50:41.007 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:41.005+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:41.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 124294 11.29 MB/sec execute 444 sec latency 529.011 ms 2022-09-17T10:50:42.016 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:42.000+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:42.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 124433 11.28 MB/sec execute 445 sec latency 111.006 ms 2022-09-17T10:50:42.962 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:42.959+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:43.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 124559 11.27 MB/sec execute 446 sec latency 120.004 ms 2022-09-17T10:50:44.007 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:44.004+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:44.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 124707 11.26 MB/sec execute 447 sec latency 139.811 ms 2022-09-17T10:50:45.034 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:45.032+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:45.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 124904 11.25 MB/sec execute 448 sec latency 302.540 ms 2022-09-17T10:50:46.090 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:46.087+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:46.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 125105 11.24 MB/sec execute 449 sec latency 79.003 ms 2022-09-17T10:50:47.062 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:47.061+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:47.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 125402 11.24 MB/sec execute 450 sec latency 96.292 ms 2022-09-17T10:50:48.088 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:48.085+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:48.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 125754 11.25 MB/sec execute 451 sec latency 108.554 ms 2022-09-17T10:50:49.061 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:49.061+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:49.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 126149 11.27 MB/sec execute 452 sec latency 75.555 ms 2022-09-17T10:50:50.052 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:50.050+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:50.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 126502 11.29 MB/sec execute 453 sec latency 99.418 ms 2022-09-17T10:50:51.081 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:51.080+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:51.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 126932 11.32 MB/sec execute 454 sec latency 72.972 ms 2022-09-17T10:50:52.100 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:52.098+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:52.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 127216 11.34 MB/sec execute 455 sec latency 80.788 ms 2022-09-17T10:50:53.110 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:53.107+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:53.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 127500 11.37 MB/sec execute 456 sec latency 86.351 ms 2022-09-17T10:50:54.117 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:54.102+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:54.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 127733 11.37 MB/sec execute 457 sec latency 82.480 ms 2022-09-17T10:50:55.140 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:55.139+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:55.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 127888 11.37 MB/sec execute 458 sec latency 92.148 ms 2022-09-17T10:50:56.133 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:56.130+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:56.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 128029 11.36 MB/sec execute 459 sec latency 95.580 ms 2022-09-17T10:50:57.130 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:57.125+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:57.366 INFO:tasks.workunit.client.0.smithi062.stdout: 10 128157 11.34 MB/sec execute 460 sec latency 130.311 ms 2022-09-17T10:50:58.102 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:58.098+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:58.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 128334 11.33 MB/sec execute 461 sec latency 83.225 ms 2022-09-17T10:50:59.150 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:50:59.147+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:50:59.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 128465 11.32 MB/sec execute 462 sec latency 420.740 ms 2022-09-17T10:51:00.116 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:00.113+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:00.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 128521 11.30 MB/sec execute 463 sec latency 890.220 ms 2022-09-17T10:51:01.104 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:01.101+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:01.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 128681 11.28 MB/sec execute 464 sec latency 166.064 ms 2022-09-17T10:51:02.124 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:02.122+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:02.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 128944 11.29 MB/sec execute 465 sec latency 127.261 ms 2022-09-17T10:51:03.192 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:03.174+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:03.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 129219 11.29 MB/sec execute 466 sec latency 111.337 ms 2022-09-17T10:51:04.184 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:04.181+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:04.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 129553 11.29 MB/sec execute 467 sec latency 102.631 ms 2022-09-17T10:51:05.202 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:05.184+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:05.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 129902 11.31 MB/sec execute 468 sec latency 78.334 ms 2022-09-17T10:51:06.193 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:06.190+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:06.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 130276 11.33 MB/sec execute 469 sec latency 102.133 ms 2022-09-17T10:51:07.238 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:07.236+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:07.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 130590 11.36 MB/sec execute 470 sec latency 69.399 ms 2022-09-17T10:51:08.192 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:08.189+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 14 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:08.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 130874 11.38 MB/sec execute 471 sec latency 82.768 ms 2022-09-17T10:51:09.177 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:09.176+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:09.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 131150 11.39 MB/sec execute 472 sec latency 77.564 ms 2022-09-17T10:51:10.151 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:10.149+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:10.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 131364 11.41 MB/sec execute 473 sec latency 153.992 ms 2022-09-17T10:51:11.120 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:11.117+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:11.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 131525 11.40 MB/sec execute 474 sec latency 85.302 ms 2022-09-17T10:51:12.143 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:12.128+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:12.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 131680 11.39 MB/sec execute 475 sec latency 103.390 ms 2022-09-17T10:51:13.169 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:13.165+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:13.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 131841 11.38 MB/sec execute 476 sec latency 86.100 ms 2022-09-17T10:51:14.154 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:14.149+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:14.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 132016 11.37 MB/sec execute 477 sec latency 109.648 ms 2022-09-17T10:51:15.176 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:15.173+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:15.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 132053 11.34 MB/sec execute 478 sec latency 588.063 ms 2022-09-17T10:51:16.215 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:16.198+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:16.367 INFO:tasks.workunit.client.0.smithi062.stdout: 10 132192 11.33 MB/sec execute 479 sec latency 532.319 ms 2022-09-17T10:51:17.242 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:17.222+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:17.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 132447 11.33 MB/sec execute 480 sec latency 112.454 ms 2022-09-17T10:51:18.239 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:18.220+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:18.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 132728 11.34 MB/sec execute 481 sec latency 139.013 ms 2022-09-17T10:51:19.258 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:19.255+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:19.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 133006 11.33 MB/sec execute 482 sec latency 130.364 ms 2022-09-17T10:51:20.256 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:20.240+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:20.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 133375 11.34 MB/sec execute 483 sec latency 111.365 ms 2022-09-17T10:51:21.250 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:21.233+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:21.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 133676 11.35 MB/sec execute 484 sec latency 459.173 ms 2022-09-17T10:51:22.262 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:22.258+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:22.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 133993 11.38 MB/sec execute 485 sec latency 130.860 ms 2022-09-17T10:51:23.248 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:23.245+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:23.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 134290 11.40 MB/sec execute 486 sec latency 210.957 ms 2022-09-17T10:51:24.254 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:24.251+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:24.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 134602 11.43 MB/sec execute 487 sec latency 90.191 ms 2022-09-17T10:51:25.228 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:25.224+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:25.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 134827 11.44 MB/sec execute 488 sec latency 89.050 ms 2022-09-17T10:51:26.259 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:26.257+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:26.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 134979 11.44 MB/sec execute 489 sec latency 98.689 ms 2022-09-17T10:51:27.281 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:27.279+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:27.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 135108 11.42 MB/sec execute 490 sec latency 129.968 ms 2022-09-17T10:51:28.306 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:28.303+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:28.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 135231 11.41 MB/sec execute 491 sec latency 140.801 ms 2022-09-17T10:51:29.320 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:29.316+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:29.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 135371 11.40 MB/sec execute 492 sec latency 116.681 ms 2022-09-17T10:51:30.349 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:30.346+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:30.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 135537 11.39 MB/sec execute 493 sec latency 113.717 ms 2022-09-17T10:51:31.348 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:31.330+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:31.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 135725 11.37 MB/sec execute 494 sec latency 111.148 ms 2022-09-17T10:51:32.300 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:32.296+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:32.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 136001 11.37 MB/sec execute 495 sec latency 73.584 ms 2022-09-17T10:51:33.266 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:33.263+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:33.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 136257 11.38 MB/sec execute 496 sec latency 230.176 ms 2022-09-17T10:51:34.289 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:34.286+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:34.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 136565 11.38 MB/sec execute 497 sec latency 317.121 ms 2022-09-17T10:51:35.261 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:35.258+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:35.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 136959 11.39 MB/sec execute 498 sec latency 81.356 ms 2022-09-17T10:51:36.223 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:36.220+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:36.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 137319 11.40 MB/sec execute 499 sec latency 76.501 ms 2022-09-17T10:51:37.202 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:37.185+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:37.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 137602 11.43 MB/sec execute 500 sec latency 77.192 ms 2022-09-17T10:51:38.146 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:38.142+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:38.368 INFO:tasks.workunit.client.0.smithi062.stdout: 10 137908 11.45 MB/sec execute 501 sec latency 91.943 ms 2022-09-17T10:51:39.128 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:39.125+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:39.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 138138 11.46 MB/sec execute 502 sec latency 101.389 ms 2022-09-17T10:51:40.089 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:40.086+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:40.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 138350 11.47 MB/sec execute 503 sec latency 94.936 ms 2022-09-17T10:51:41.090 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:41.085+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:41.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 138526 11.48 MB/sec execute 504 sec latency 79.703 ms 2022-09-17T10:51:42.053 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:42.036+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:42.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 138673 11.46 MB/sec execute 505 sec latency 73.735 ms 2022-09-17T10:51:43.043 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:43.041+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:43.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 138803 11.45 MB/sec execute 506 sec latency 87.838 ms 2022-09-17T10:51:44.071 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:44.068+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:44.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 138934 11.44 MB/sec execute 507 sec latency 147.105 ms 2022-09-17T10:51:45.131 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:45.129+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:45.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 139097 11.43 MB/sec execute 508 sec latency 128.827 ms 2022-09-17T10:51:46.135 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:46.131+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:46.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 139300 11.42 MB/sec execute 509 sec latency 136.307 ms 2022-09-17T10:51:47.167 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:47.162+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:47.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 139587 11.41 MB/sec execute 510 sec latency 71.503 ms 2022-09-17T10:51:48.176 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:48.172+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:48.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 139874 11.42 MB/sec execute 511 sec latency 117.800 ms 2022-09-17T10:51:49.227 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:49.206+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:49.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 140200 11.43 MB/sec execute 512 sec latency 83.771 ms 2022-09-17T10:51:50.234 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:50.213+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:50.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 140494 11.43 MB/sec execute 513 sec latency 248.206 ms 2022-09-17T10:51:51.255 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:51.251+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:51.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 140509 11.41 MB/sec execute 514 sec latency 697.229 ms 2022-09-17T10:51:52.227 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:52.220+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:52.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 140518 11.39 MB/sec execute 515 sec latency 1649.176 ms 2022-09-17T10:51:53.274 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:53.269+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:53.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 140785 11.39 MB/sec execute 516 sec latency 612.483 ms 2022-09-17T10:51:54.269 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:54.264+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:54.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 140982 11.40 MB/sec execute 517 sec latency 144.610 ms 2022-09-17T10:51:55.342 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:55.339+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:55.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 141136 11.40 MB/sec execute 518 sec latency 153.274 ms 2022-09-17T10:51:56.344 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:56.342+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:56.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 141348 11.40 MB/sec execute 519 sec latency 115.267 ms 2022-09-17T10:51:57.310 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:57.307+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:57.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 141561 11.42 MB/sec execute 520 sec latency 116.802 ms 2022-09-17T10:51:58.311 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:58.308+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:58.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 141738 11.42 MB/sec execute 521 sec latency 224.394 ms 2022-09-17T10:51:59.269 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:51:59.265+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:51:59.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 141897 11.42 MB/sec execute 522 sec latency 150.955 ms 2022-09-17T10:52:00.301 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:00.295+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:00.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142042 11.42 MB/sec execute 523 sec latency 110.665 ms 2022-09-17T10:52:01.341 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:01.339+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:01.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142147 11.41 MB/sec execute 524 sec latency 135.311 ms 2022-09-17T10:52:02.306 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:02.303+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:02.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142242 11.39 MB/sec execute 525 sec latency 105.833 ms 2022-09-17T10:52:03.279 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:03.276+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:03.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142331 11.38 MB/sec execute 526 sec latency 224.437 ms 2022-09-17T10:52:04.304 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:04.302+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:04.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142407 11.36 MB/sec execute 527 sec latency 184.763 ms 2022-09-17T10:52:05.314 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:05.312+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:05.369 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142506 11.35 MB/sec execute 528 sec latency 145.785 ms 2022-09-17T10:52:06.300 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:06.296+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:06.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142612 11.33 MB/sec execute 529 sec latency 128.716 ms 2022-09-17T10:52:07.313 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:07.311+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:07.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142714 11.31 MB/sec execute 530 sec latency 270.611 ms 2022-09-17T10:52:08.323 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:08.316+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:08.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142814 11.30 MB/sec execute 531 sec latency 248.334 ms 2022-09-17T10:52:09.332 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:09.298+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:09.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 142933 11.29 MB/sec execute 532 sec latency 357.937 ms 2022-09-17T10:52:10.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 143116 11.28 MB/sec execute 533 sec latency 232.440 ms 2022-09-17T10:52:10.372 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:10.369+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:11.346 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:11.342+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:11.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 143291 11.27 MB/sec execute 534 sec latency 182.875 ms 2022-09-17T10:52:12.332 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:12.329+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:12.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 143508 11.28 MB/sec execute 535 sec latency 286.640 ms 2022-09-17T10:52:13.302 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:13.298+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:13.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 143758 11.28 MB/sec execute 536 sec latency 182.175 ms 2022-09-17T10:52:14.302 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:14.275+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:14.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 143924 11.27 MB/sec execute 537 sec latency 452.517 ms 2022-09-17T10:52:15.251 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:15.248+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:15.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 144342 11.28 MB/sec execute 538 sec latency 101.450 ms 2022-09-17T10:52:16.218 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:16.214+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:16.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 144609 11.29 MB/sec execute 539 sec latency 80.805 ms 2022-09-17T10:52:17.243 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:17.240+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:17.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 144928 11.32 MB/sec execute 540 sec latency 111.590 ms 2022-09-17T10:52:18.266 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:18.263+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:18.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 145185 11.33 MB/sec execute 541 sec latency 396.692 ms 2022-09-17T10:52:19.330 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:19.307+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:19.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 145437 11.35 MB/sec execute 542 sec latency 460.401 ms 2022-09-17T10:52:20.283 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:20.282+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:20.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 145629 11.36 MB/sec execute 543 sec latency 361.062 ms 2022-09-17T10:52:21.283 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:21.282+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:21.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 145779 11.35 MB/sec execute 544 sec latency 91.170 ms 2022-09-17T10:52:22.300 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:22.298+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:22.376 INFO:tasks.workunit.client.0.smithi062.stdout: 10 145896 11.34 MB/sec execute 545 sec latency 91.084 ms 2022-09-17T10:52:23.284 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:23.282+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:23.370 INFO:tasks.workunit.client.0.smithi062.stdout: 10 146032 11.32 MB/sec execute 546 sec latency 111.561 ms 2022-09-17T10:52:24.289 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:24.286+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:24.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 146179 11.31 MB/sec execute 547 sec latency 139.482 ms 2022-09-17T10:52:25.292 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:25.288+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:25.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 146389 11.30 MB/sec execute 548 sec latency 85.253 ms 2022-09-17T10:52:26.284 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:26.282+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:26.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 146605 11.30 MB/sec execute 549 sec latency 242.949 ms 2022-09-17T10:52:27.254 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:27.251+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:2779 4.3e 4:7f23b022:::100000004e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:27.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 146913 11.30 MB/sec execute 550 sec latency 83.325 ms 2022-09-17T10:52:28.282 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:28.280+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:28.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 147251 11.32 MB/sec execute 551 sec latency 94.842 ms 2022-09-17T10:52:29.303 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:29.300+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:29.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 147603 11.32 MB/sec execute 552 sec latency 119.753 ms 2022-09-17T10:52:30.358 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:30.355+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:30.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 148037 11.34 MB/sec execute 553 sec latency 114.221 ms 2022-09-17T10:52:31.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 148294 11.34 MB/sec execute 554 sec latency 107.761 ms 2022-09-17T10:52:31.418 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:31.415+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:32.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 148553 11.37 MB/sec execute 555 sec latency 117.101 ms 2022-09-17T10:52:32.469 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:32.436+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:33.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 148718 11.38 MB/sec execute 556 sec latency 237.265 ms 2022-09-17T10:52:33.399 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:33.398+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:34.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 148882 11.37 MB/sec execute 557 sec latency 221.823 ms 2022-09-17T10:52:34.387 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:34.384+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:35.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149058 11.38 MB/sec execute 558 sec latency 112.541 ms 2022-09-17T10:52:35.411 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:35.409+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:36.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149184 11.38 MB/sec execute 559 sec latency 167.688 ms 2022-09-17T10:52:36.441 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:36.416+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:37.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149196 11.36 MB/sec execute 560 sec latency 558.473 ms 2022-09-17T10:52:37.402 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:37.399+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:38.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149205 11.34 MB/sec execute 561 sec latency 1386.280 ms 2022-09-17T10:52:38.448 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:38.447+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:39.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149297 11.33 MB/sec execute 562 sec latency 394.110 ms 2022-09-17T10:52:39.460 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:39.457+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:40.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149395 11.31 MB/sec execute 563 sec latency 168.429 ms 2022-09-17T10:52:40.476 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:40.473+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:41.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149485 11.30 MB/sec execute 564 sec latency 216.691 ms 2022-09-17T10:52:41.500 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:41.474+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:42.371 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149609 11.28 MB/sec execute 565 sec latency 97.779 ms 2022-09-17T10:52:42.451 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:42.445+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:43.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149710 11.27 MB/sec execute 566 sec latency 154.626 ms 2022-09-17T10:52:43.444 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:43.442+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:44.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149795 11.25 MB/sec execute 567 sec latency 355.011 ms 2022-09-17T10:52:44.424 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:44.421+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:45.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 149921 11.24 MB/sec execute 568 sec latency 196.785 ms 2022-09-17T10:52:45.445 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:45.442+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:46.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 150056 11.23 MB/sec execute 569 sec latency 215.489 ms 2022-09-17T10:52:46.486 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:46.482+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:47.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 150240 11.22 MB/sec execute 570 sec latency 242.989 ms 2022-09-17T10:52:47.546 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:47.520+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:48.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 150498 11.22 MB/sec execute 571 sec latency 204.081 ms 2022-09-17T10:52:48.493 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:48.489+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:49.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 150758 11.23 MB/sec execute 572 sec latency 152.713 ms 2022-09-17T10:52:49.552 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:49.550+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:50.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 151048 11.23 MB/sec execute 573 sec latency 230.562 ms 2022-09-17T10:52:50.517 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:50.514+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:51.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 151397 11.24 MB/sec execute 574 sec latency 215.456 ms 2022-09-17T10:52:51.571 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:51.569+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:52.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 151753 11.25 MB/sec execute 575 sec latency 66.107 ms 2022-09-17T10:52:52.585 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:52.583+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:53.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 152025 11.28 MB/sec execute 576 sec latency 144.064 ms 2022-09-17T10:52:53.564 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:53.560+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:54.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 152294 11.30 MB/sec execute 577 sec latency 88.360 ms 2022-09-17T10:52:54.552 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:54.549+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:55.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 152504 11.30 MB/sec execute 578 sec latency 96.130 ms 2022-09-17T10:52:55.585 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:55.582+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:56.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 152672 11.30 MB/sec execute 579 sec latency 218.229 ms 2022-09-17T10:52:56.601 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:56.598+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:57.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 152751 11.30 MB/sec execute 580 sec latency 526.068 ms 2022-09-17T10:52:57.628 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:57.625+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:58.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 152858 11.29 MB/sec execute 581 sec latency 130.367 ms 2022-09-17T10:52:58.603 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:58.600+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:52:59.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 152974 11.27 MB/sec execute 582 sec latency 237.756 ms 2022-09-17T10:52:59.650 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:52:59.648+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:00.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 153102 11.26 MB/sec execute 583 sec latency 118.851 ms 2022-09-17T10:53:00.667 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:00.664+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:01.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 153242 11.25 MB/sec execute 584 sec latency 100.982 ms 2022-09-17T10:53:01.716 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:01.712+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:02.374 INFO:tasks.workunit.client.0.smithi062.stdout: 10 153401 11.24 MB/sec execute 585 sec latency 265.255 ms 2022-09-17T10:53:02.759 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:02.756+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:03.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 153608 11.23 MB/sec execute 586 sec latency 295.916 ms 2022-09-17T10:53:03.725 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:03.723+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:04.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 153981 11.23 MB/sec execute 587 sec latency 72.094 ms 2022-09-17T10:53:04.770 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:04.768+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 10 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:05.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 154279 11.25 MB/sec execute 588 sec latency 74.001 ms 2022-09-17T10:53:05.772 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:05.755+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:06.379 INFO:tasks.workunit.client.0.smithi062.stdout: 10 154706 11.27 MB/sec execute 589 sec latency 74.734 ms 2022-09-17T10:53:06.760 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:06.759+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:07.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 155165 11.27 MB/sec execute 590 sec latency 72.746 ms 2022-09-17T10:53:07.813 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:07.811+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:08.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 155487 11.30 MB/sec execute 591 sec latency 69.164 ms 2022-09-17T10:53:08.805 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:08.802+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:09.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 155811 11.33 MB/sec execute 592 sec latency 76.218 ms 2022-09-17T10:53:09.836 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:09.833+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:10.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 156106 11.35 MB/sec execute 593 sec latency 67.929 ms 2022-09-17T10:53:10.871 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:10.869+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:11.372 INFO:tasks.workunit.client.0.smithi062.stdout: 10 156306 11.36 MB/sec execute 594 sec latency 82.142 ms 2022-09-17T10:53:11.849 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:11.827+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:12.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 156399 11.34 MB/sec execute 595 sec latency 276.559 ms 2022-09-17T10:53:12.810 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:12.804+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:3223 4.3e 4:7d5d4b1e:::100000005e6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:13.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 156410 11.32 MB/sec execute 596 sec latency 960.797 ms 2022-09-17T10:53:13.762 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:13.760+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:14.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 156475 11.31 MB/sec execute 597 sec latency 1275.951 ms 2022-09-17T10:53:14.809 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:14.806+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:15.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 156585 11.29 MB/sec execute 598 sec latency 126.860 ms 2022-09-17T10:53:15.822 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:15.821+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:16.373 INFO:tasks.workunit.client.0.smithi062.stdout: 10 156710 11.28 MB/sec execute 599 sec latency 101.989 ms 2022-09-17T10:53:16.887 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:16.869+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:17.374 INFO:tasks.workunit.client.0.smithi062.stdout: 10 cleanup 600 sec 2022-09-17T10:53:17.919 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:17.915+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:18.376 INFO:tasks.workunit.client.0.smithi062.stdout: 10 cleanup 601 sec 2022-09-17T10:53:18.959 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:18.958+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:19.374 INFO:tasks.workunit.client.0.smithi062.stdout: 10 cleanup 602 sec 2022-09-17T10:53:19.951 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:19.949+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:20.192 INFO:tasks.workunit.client.0.smithi062.stdout: 0 cleanup 603 sec 2022-09-17T10:53:20.192 INFO:tasks.workunit.client.0.smithi062.stdout: 2022-09-17T10:53:20.192 INFO:tasks.workunit.client.0.smithi062.stdout: Operation Count AvgLat MaxLat 2022-09-17T10:53:20.193 INFO:tasks.workunit.client.0.smithi062.stdout: ---------------------------------------- 2022-09-17T10:53:20.193 INFO:tasks.workunit.client.0.smithi062.stdout: NTCreateX 217101 11.163 2000.103 2022-09-17T10:53:20.193 INFO:tasks.workunit.client.0.smithi062.stdout: Close 159066 0.002 0.122 2022-09-17T10:53:20.193 INFO:tasks.workunit.client.0.smithi062.stdout: Rename 9181 46.575 1350.424 2022-09-17T10:53:20.194 INFO:tasks.workunit.client.0.smithi062.stdout: Unlink 44111 17.106 1259.454 2022-09-17T10:53:20.194 INFO:tasks.workunit.client.0.smithi062.stdout: Qpathinfo 196558 8.508 1988.279 2022-09-17T10:53:20.194 INFO:tasks.workunit.client.0.smithi062.stdout: Qfileinfo 34137 0.001 0.038 2022-09-17T10:53:20.195 INFO:tasks.workunit.client.0.smithi062.stdout: Qfsinfo 36206 0.137 17.796 2022-09-17T10:53:20.195 INFO:tasks.workunit.client.0.smithi062.stdout: Sfileinfo 17590 3.023 960.310 2022-09-17T10:53:20.196 INFO:tasks.workunit.client.0.smithi062.stdout: Find 76052 1.291 1259.396 2022-09-17T10:53:20.196 INFO:tasks.workunit.client.0.smithi062.stdout: WriteX 106987 0.393 891.772 2022-09-17T10:53:20.197 INFO:tasks.workunit.client.0.smithi062.stdout: ReadX 340103 0.094 660.899 2022-09-17T10:53:20.198 INFO:tasks.workunit.client.0.smithi062.stdout: LockX 702 14.424 105.319 2022-09-17T10:53:20.198 INFO:tasks.workunit.client.0.smithi062.stdout: UnlockX 702 13.847 183.272 2022-09-17T10:53:20.198 INFO:tasks.workunit.client.0.smithi062.stdout: Flush 15168 30.925 890.215 2022-09-17T10:53:20.199 INFO:tasks.workunit.client.0.smithi062.stdout: 2022-09-17T10:53:20.199 INFO:tasks.workunit.client.0.smithi062.stdout:Throughput 11.2807 MB/sec 10 clients 10 procs max_latency=2000.108 ms 2022-09-17T10:53:20.200 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-09-17T10:53:20.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-09-17T10:53:20.957 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:20.932+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:21.150 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2022-09-17T10:53:21.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2022-09-17T10:53:21.368 DEBUG:teuthology.parallel:result is None 2022-09-17T10:53:21.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2022-09-17T10:53:21.408 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2022-09-17T10:53:21.409 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2022-09-17T10:53:21.427 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2022-09-17T10:53:21.443 INFO:tasks.kclient:Unmounting kernel clients... 2022-09-17T10:53:21.443 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2022-09-17T10:53:21.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-09-17T10:53:21.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.0 2022-09-17T10:53:21.911 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:21.909+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:22.890 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:22.886+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:23.908 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:23.905+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:24.953 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:24.951+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:25.921 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:25.919+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:26.894 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:26.892+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:27.908 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:27.907+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:28.910 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:28.909+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:29.903 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:29.902+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:30.947 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:30.946+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:31.910 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:31.910+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:32.924 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:32.923+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:33.917 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:33.916+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:34.909 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:34.907+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:35.884 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:35.883+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:36.851 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:36.851+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:37.899 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:37.897+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:38.915 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:38.914+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:39.876 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:39.876+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:40.923 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:40.922+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:41.919 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:41.918+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:42.893 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:42.892+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:43.913 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:43.912+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:44.867 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:44.865+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:45.885 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:45.885+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:46.867 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:46.867+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:47.907 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:47.904+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:48.863 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:48.862+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:49.816 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:49.815+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:50.821 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:50.819+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:51.801 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:51.794+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:52.785 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:52.784+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:53.834 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:53.834+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:54.849 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:54.849+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:55.847 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:55.846+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:56.860 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:56.860+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:57.817 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:57.817+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:58.843 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:58.842+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:53:59.812 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:53:59.812+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:00.788 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:00.788+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:01.751 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:01.751+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:02.740 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:02.739+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:03.783 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:03.782+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:04.745 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:04.744+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:05.718 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:05.717+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:06.738 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:06.732+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:07.696 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:07.694+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:08.676 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:08.675+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:09.707 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:09.706+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:10.700 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:10.699+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:11.679 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:11.679+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:12.720 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:12.720+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:13.766 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:13.765+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:14.794 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:14.793+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:15.776 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:15.776+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:16.810 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:16.809+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:17.816 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:17.816+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:18.797 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:18.797+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:19.788 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:19.788+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:20.782 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:20.781+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:21.761 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:21.758+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:22.806 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:22.805+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:23.818 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:23.818+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:24.866 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:24.864+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:25.907 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:25.907+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:26.914 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:26.914+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:27.940 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:27.940+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:28.950 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:28.950+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:29.989 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:29.989+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:30.950 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:30.950+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:31.937 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:31.937+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:32.901 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:32.900+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:33.895 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:33.895+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:34.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:54:34.731 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:54:34.734 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T10:54:34.817 INFO:tasks.ceph.osd.0.smithi062.stderr:2022-09-17T10:54:34.817+0000 7f90200c7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91203) UID: 0 2022-09-17T10:54:34.818 INFO:tasks.ceph.osd.3.smithi062.stderr:2022-09-17T10:54:34.817+0000 7fdaea491700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91203) UID: 0 2022-09-17T10:54:34.818 INFO:tasks.ceph.osd.9.smithi062.stderr:2022-09-17T10:54:34.817+0000 7f65b4ce1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91203) UID: 0 2022-09-17T10:54:34.819 INFO:tasks.ceph.osd.6.smithi062.stderr:2022-09-17T10:54:34.817+0000 7f28a2d46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91203) UID: 0 2022-09-17T10:54:34.847 INFO:tasks.ceph.osd.4.smithi093.stderr:2022-09-17T10:54:34.845+0000 7f059b98b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86078) UID: 0 2022-09-17T10:54:34.847 INFO:tasks.ceph.osd.7.smithi093.stderr:2022-09-17T10:54:34.845+0000 7f66ab07d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86078) UID: 0 2022-09-17T10:54:34.848 INFO:tasks.ceph.osd.10.smithi093.stderr:2022-09-17T10:54:34.845+0000 7f47ae94c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86078) UID: 0 2022-09-17T10:54:34.848 INFO:tasks.ceph.osd.1.smithi093.stderr:2022-09-17T10:54:34.845+0000 7fc1cc760700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86078) UID: 0 2022-09-17T10:54:34.940 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:34.940+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:35.316 INFO:tasks.ceph.mds.c.smithi159.stderr:2022-09-17T10:54:35.315+0000 7faa6c70b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 87819) UID: 0 2022-09-17T10:54:35.317 INFO:tasks.ceph.mds.f.smithi159.stderr:2022-09-17T10:54:35.315+0000 7f9d5e235700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 87819) UID: 0 2022-09-17T10:54:35.318 INFO:tasks.ceph.mds.i.smithi159.stderr:2022-09-17T10:54:35.315+0000 7f353b18a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 87819) UID: 0 2022-09-17T10:54:35.319 INFO:tasks.ceph.mds.l.smithi159.stderr:2022-09-17T10:54:35.316+0000 7fe761d36700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 87819) UID: 0 2022-09-17T10:54:35.968 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:35.968+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:36.944 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:36.944+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:37.971 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:37.969+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:38.968 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:38.967+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:40.006 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:40.002+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:41.050 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:41.049+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:42.006 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:42.003+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:42.983 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:42.982+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:43.980 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:43.979+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:44.978 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:44.978+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:45.933 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:45.933+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:46.983 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:46.983+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:47.955 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:47.955+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:49.004 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:49.000+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:50.015 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:50.015+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:51.039 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:51.038+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:52.024 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:52.023+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:53.051 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:53.050+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:54.076 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:54.076+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:55.037 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:55.035+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:56.017 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:56.017+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:56.989 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:56.989+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:57.973 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:57.972+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:58.924 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:58.924+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:54:59.895 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:54:59.895+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:00.950 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:00.944+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:01.990 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:01.988+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:02.974 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:02.973+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:03.969 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:03.969+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:04.952 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:04.952+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:05.962 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:05.962+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:06.971 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:06.971+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:07.958 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:07.957+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:08.993 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:08.993+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:10.033 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:10.029+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:10.994 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:10.993+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:12.029 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:12.028+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:13.074 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:13.073+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:14.096 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:14.095+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:15.092 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:15.092+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:16.139 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:16.134+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:17.182 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:17.182+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:18.172 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:18.171+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:19.130 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:19.123+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:20.104 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:20.103+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:21.060 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:21.059+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:22.078 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:22.076+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:23.115 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:23.113+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:24.156 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:24.156+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:25.155 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:25.155+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:26.116 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:26.115+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:27.069 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:27.069+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:28.021 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:28.021+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:29.010 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:29.010+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:30.034 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:30.034+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:31.079 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:31.079+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:32.094 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:32.094+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:33.089 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:33.089+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:34.076 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:34.076+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:35.038 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:35.032+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:36.013 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:36.012+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:36.985 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:36.985+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:37.962 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:37.959+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:38.922 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:38.921+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:39.958 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:39.958+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:40.948 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:40.948+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:41.933 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:41.929+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:42.958 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:42.958+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:43.922 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:43.922+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:44.909 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:44.908+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:45.928 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:45.927+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:46.939 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:46.939+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:47.958 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:47.955+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:48.968 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:48.963+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:49.976 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:49.956+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:50.924 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:50.922+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:51.928 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:51.927+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:52.976 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:52.975+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:53.929 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:53.926+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:54.963 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:54.963+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:55.933 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:55.932+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:56.887 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:56.887+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:57.859 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:57.859+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:58.881 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:58.881+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:55:59.873 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:55:59.873+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:00.827 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:00.826+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:01.802 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:01.802+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:02.785 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:02.785+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:03.752 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:03.752+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:04.741 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:04.741+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:05.714 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:05.714+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:06.691 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:06.690+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:07.685 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:07.685+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:08.734 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:08.734+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:09.700 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:09.700+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:10.669 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:10.669+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:11.660 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:11.657+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:12.692 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:12.692+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:13.718 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:13.717+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:14.728 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:14.728+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:15.769 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:15.769+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:16.810 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:16.809+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:17.799 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:17.798+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:18.840 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:18.840+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:19.890 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:19.889+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:20.869 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:20.869+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:21.913 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:21.913+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:22.942 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:22.942+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:23.907 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:23.907+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:24.870 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:24.868+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:25.882 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:25.879+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:26.861 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:26.861+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:27.854 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:27.854+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:28.839 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:28.836+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:29.845 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:29.845+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:30.825 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:30.825+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:31.810 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:31.810+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:32.883 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:32.881+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:33.918 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:33.918+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:34.881 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:34.881+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:35.838 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:35.838+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:36.848 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:36.848+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:37.855 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:37.854+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:38.878 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:38.878+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:39.860 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:39.857+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:40.837 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:40.836+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:41.874 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:41.874+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:42.848 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:42.848+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:43.837 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:43.837+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:44.799 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:44.798+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:45.846 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:45.846+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:46.865 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:46.865+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:47.837 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:47.836+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:48.823 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:48.823+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:49.793 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:49.792+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:50.835 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:50.835+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:51.858 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:51.857+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:52.869 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:52.868+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:53.895 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:53.895+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:54.895 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:54.895+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:55.920 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:55.917+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:56.918 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:56.918+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:57.940 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:57.939+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:58.931 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:58.931+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:56:59.898 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:56:59.898+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:00.928 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:00.928+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:01.972 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:01.971+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:03.010 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:03.009+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:04.000 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:04.000+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:05.005 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:05.005+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:06.061 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:06.057+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:07.014 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:07.013+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:07.981 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:07.981+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:08.945 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:08.944+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:09.937 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:09.936+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:10.982 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:10.982+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:12.022 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:12.022+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:13.003 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:13.003+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:14.006 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:14.005+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:14.973 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:14.972+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:15.947 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:15.947+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:16.938 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:16.938+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:17.971 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:17.971+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:19.005 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:19.003+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:19.977 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:19.977+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:20.952 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:20.952+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:21.925 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:21.925+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:22.973 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:22.973+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:24.002 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:24.001+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:25.024 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:25.024+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:25.994 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:25.993+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:27.038 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:27.037+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:28.014 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:28.014+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:29.063 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:29.063+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:30.063 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:30.062+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:31.048 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:31.048+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:32.081 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:32.078+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:33.121 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:33.121+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:34.088 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:34.088+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:35.122 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:35.122+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:36.119 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:36.119+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:37.082 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:37.082+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:38.113 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:38.113+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:39.149 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:39.148+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:40.182 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:40.182+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:41.164 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:41.164+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:42.121 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:42.120+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:43.127 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:43.124+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:44.129 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:44.128+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:45.164 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:45.164+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:46.186 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:46.175+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:47.171 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:47.169+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:48.175 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:48.174+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:49.129 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:49.128+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:50.130 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:50.129+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:51.100 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:51.099+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:52.084 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:52.083+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:53.041 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:53.039+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:54.019 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:54.017+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:55.036 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:55.034+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:55.994 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:55.993+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:56.971 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:56.965+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:57.966 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:57.965+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:58.930 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:58.929+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:57:59.890 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:57:59.889+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:00.884 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:00.883+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:01.844 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:01.842+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:02.809 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:02.808+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:03.774 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:03.772+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:04.731 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:04.730+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:05.682 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:05.681+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:06.690 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:06.689+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:07.731 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:07.730+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:08.739 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:08.738+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:09.718 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:09.717+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:10.742 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:10.741+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:11.694 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:11.693+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:12.673 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:12.671+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:13.713 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:13.712+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:14.751 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:14.749+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:15.741 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:15.740+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:16.775 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:16.773+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:17.814 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:17.813+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:18.772 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:18.770+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:19.788 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:19.787+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:20.809 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:20.808+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:21.851 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:21.850+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:22.805 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:22.804+0000 7f3caac6e700 -1 osd.8 33 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:23.798 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:23.796+0000 7f3caac6e700 -1 osd.8 34 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:24.824 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:24.823+0000 7f3caac6e700 -1 osd.8 34 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:25.829 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:25.829+0000 7f3caac6e700 -1 osd.8 34 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:26.797 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:26.796+0000 7f3caac6e700 -1 osd.8 34 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:27.801 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:27.800+0000 7f3caac6e700 -1 osd.8 34 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:28.787 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:28.785+0000 7f3caac6e700 -1 osd.8 34 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:29.816 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:29.815+0000 7f3caac6e700 -1 osd.8 34 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T10:58:30.854 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T10:58:30.853+0000 7f3caac6e700 -1 osd.8 34 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:365 4.3e 4:7cdff9df:::10000000271.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force e33) 2022-09-17T11:05:03.252 INFO:tasks.ceph.osd.2.smithi159.stderr:2022-09-17T11:05:03.246+0000 7ff47a94b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 87930) UID: 0 2022-09-17T11:05:03.281 INFO:tasks.ceph.osd.5.smithi159.stderr:2022-09-17T11:05:03.246+0000 7ff583417700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 87930) UID: 0 2022-09-17T11:05:03.290 INFO:tasks.ceph.osd.11.smithi159.stderr:2022-09-17T11:05:03.247+0000 7f226e83e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 87930) UID: 0 2022-09-17T11:05:03.291 INFO:tasks.ceph.osd.8.smithi159.stderr:2022-09-17T11:05:03.247+0000 7f3cadcf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 87930) UID: 0 2022-09-17T11:08:21.457 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-09-17T11:08:21.491 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-09-17T11:17:01.825 INFO:tasks.ceph.osd.3.smithi062.stderr:2022-09-17T11:17:01.822+0000 7fdaea491700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91586) UID: 0 2022-09-17T11:17:01.828 INFO:tasks.ceph.osd.6.smithi062.stderr:2022-09-17T11:17:01.822+0000 7f28a2d46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91586) UID: 0 2022-09-17T11:17:01.829 INFO:tasks.ceph.osd.9.smithi062.stderr:2022-09-17T11:17:01.822+0000 7f65b4ce1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91586) UID: 0 2022-09-17T11:17:01.829 INFO:tasks.ceph.osd.0.smithi062.stderr:2022-09-17T11:17:01.822+0000 7f90200c7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91586) UID: 0 2022-09-17T11:27:54.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:27:54.987 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:27:54.991 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:27:55.294 INFO:tasks.ceph.osd.4.smithi093.stderr:2022-09-17T11:27:55.294+0000 7f059b98b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86400) UID: 0 2022-09-17T11:27:55.295 INFO:tasks.ceph.osd.1.smithi093.stderr:2022-09-17T11:27:55.294+0000 7fc1cc760700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86400) UID: 0 2022-09-17T11:27:55.296 INFO:tasks.ceph.osd.7.smithi093.stderr:2022-09-17T11:27:55.294+0000 7f66ab07d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86400) UID: 0 2022-09-17T11:27:55.296 INFO:tasks.ceph.osd.10.smithi093.stderr:2022-09-17T11:27:55.294+0000 7f47ae94c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 86400) UID: 0 2022-09-17T11:38:33.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:38:33.556 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:38:33.560 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:39:03.659 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:39:03.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:39:03.666 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:39:33.923 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:39:33.927 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:39:33.930 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:40:04.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:40:04.040 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:40:04.043 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:40:34.175 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:40:34.181 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:40:34.184 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:41:04.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:41:04.295 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:41:04.299 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:41:34.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:41:34.432 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:41:34.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:42:04.525 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:42:04.530 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:42:04.533 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:42:34.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:42:34.694 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:42:34.697 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:43:04.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:43:04.817 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:43:04.821 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:43:34.953 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:43:34.966 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:43:34.973 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:44:05.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:44:05.070 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:44:05.073 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:44:35.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:44:35.360 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:44:35.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:45:05.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:45:05.547 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:45:05.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:45:35.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:45:35.617 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:45:35.624 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:46:05.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:46:05.768 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:46:05.772 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:46:35.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:46:35.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:46:35.930 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:47:06.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:47:06.068 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:47:06.073 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:47:36.216 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:47:36.220 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:47:36.224 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:48:06.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:48:06.360 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:48:06.364 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:48:36.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:48:36.472 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:48:36.477 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:49:06.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:49:06.744 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:49:06.749 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:49:36.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:49:36.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:49:36.896 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:50:07.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:50:07.023 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:50:07.027 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:50:37.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:50:37.168 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:50:37.171 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:51:07.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:51:07.499 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:51:07.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:51:37.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:51:37.654 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:51:37.659 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:52:07.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:52:07.732 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:52:07.740 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:52:37.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:52:37.902 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:52:37.906 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:53:08.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:53:08.040 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:53:08.043 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:53:38.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:53:38.163 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:53:38.167 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:54:08.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:54:08.309 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:54:08.313 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:54:38.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:54:38.432 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:54:38.443 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:55:08.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:55:08.563 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:55:08.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:55:38.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:55:38.702 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:55:38.707 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:56:08.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:56:08.839 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:56:08.843 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:56:38.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:56:38.987 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:56:38.990 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:57:09.113 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:57:09.118 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:57:09.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:57:39.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:57:39.266 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:57:39.271 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:58:09.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:58:09.422 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:58:09.427 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:58:39.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:58:39.552 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:58:39.557 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:59:09.678 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:59:09.683 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:59:09.686 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:59:39.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:59:39.822 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T11:59:39.826 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:00:09.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:00:09.959 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:00:09.962 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:00:40.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:00:40.124 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:00:40.127 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:01:10.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:01:10.284 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:01:10.288 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:01:40.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:01:40.430 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:01:40.433 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:02:10.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:02:10.560 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:02:10.563 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:02:40.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:02:40.692 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:02:40.695 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:03:10.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:03:10.852 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:03:10.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:03:41.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:03:41.009 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:03:41.012 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:04:11.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:04:11.184 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:04:11.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:04:41.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:04:41.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:04:41.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:05:11.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:05:11.446 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:05:11.448 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:05:41.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:05:41.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:05:41.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:06:11.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:06:11.616 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:06:11.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:06:41.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:06:41.754 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:06:41.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:07:11.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:07:11.876 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:07:11.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:07:41.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:07:41.999 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:07:42.002 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:08:12.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:08:12.120 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:08:12.123 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:08:42.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:08:42.270 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:08:42.273 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:09:12.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:09:12.394 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:09:12.398 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:09:42.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:09:42.540 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:09:42.544 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:10:12.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:10:12.670 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:10:12.673 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:10:42.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:10:42.827 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:10:42.830 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:11:12.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:11:12.974 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:11:12.977 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:11:43.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:11:43.078 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:11:43.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:12:13.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:12:13.211 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:12:13.222 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:12:43.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:12:43.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:12:43.379 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:13:13.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:13:13.472 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:13:13.476 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:13:43.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:13:43.638 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:13:43.644 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:14:13.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:14:13.825 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:14:13.830 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:14:43.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:14:43.923 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:14:43.926 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:15:14.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:15:14.088 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:15:14.092 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:15:44.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:15:44.248 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:15:44.251 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:16:14.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:16:14.407 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:16:14.410 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:16:44.573 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:16:44.579 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:16:44.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:17:14.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:17:14.710 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:17:14.713 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:17:44.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:17:44.864 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:17:44.869 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:18:14.997 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:18:15.001 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:18:15.004 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:18:45.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:18:45.135 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:18:45.140 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:19:15.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:19:15.289 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:19:15.292 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:19:45.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:19:45.418 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:19:45.421 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:20:15.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:20:15.558 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:20:15.561 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:20:45.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:20:45.711 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:20:45.714 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:21:15.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:21:15.832 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:21:15.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:21:46.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:21:46.054 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:21:46.058 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:22:16.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:22:16.132 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:22:16.135 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:22:46.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:22:46.270 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:22:46.273 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:23:16.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:23:16.402 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:23:16.405 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:23:46.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:23:46.535 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:23:46.538 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:24:16.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:24:16.675 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:24:16.679 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:24:46.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:24:46.780 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:24:46.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:25:16.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:25:16.944 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:25:16.947 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:25:47.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:25:47.083 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:25:47.086 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:26:17.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:26:17.201 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:26:17.205 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:26:47.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:26:47.361 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:26:47.367 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:27:17.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:27:17.615 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:27:17.618 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:27:47.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:27:47.689 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:27:47.692 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:28:17.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:28:17.832 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:28:17.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:28:47.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:28:47.996 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:28:48.009 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:29:18.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:29:18.087 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:29:18.091 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:29:48.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:29:48.225 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:29:48.233 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:30:18.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:30:18.308 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:30:18.312 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:30:48.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:30:48.462 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:30:48.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:31:18.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:31:18.542 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:31:18.545 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:31:48.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:31:48.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:31:48.647 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:32:18.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:32:18.805 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:32:18.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:32:48.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:32:48.909 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:32:48.913 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:33:19.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:33:19.058 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:33:19.063 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:33:49.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:33:49.190 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:33:49.211 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:34:19.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:34:19.359 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:34:19.370 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:34:49.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:34:49.501 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:34:49.507 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:35:19.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:35:19.670 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:35:19.675 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:35:49.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:35:49.818 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:35:49.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:36:19.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:36:19.933 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:36:19.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:36:50.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:36:50.075 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:36:50.077 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:37:20.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:37:20.190 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:37:20.192 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:37:50.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:37:50.323 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:37:50.328 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:38:20.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:38:20.549 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:38:20.554 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:38:50.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:38:50.701 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:38:50.705 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:39:20.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:39:20.874 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:39:20.882 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:39:50.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:39:50.996 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:39:51.000 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:40:21.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:40:21.142 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:40:21.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:40:51.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:40:51.293 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:40:51.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:41:21.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:41:21.438 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:41:21.441 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:41:51.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:41:51.584 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:41:51.587 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:42:21.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:42:21.735 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:42:21.740 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:42:51.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:42:51.877 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:42:51.881 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:43:21.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:43:22.000 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:43:22.003 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:43:52.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:43:52.148 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:43:52.151 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:44:22.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:44:22.303 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:44:22.306 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:44:52.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:44:52.443 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:44:52.450 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:45:22.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:45:22.574 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:45:22.577 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:45:52.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:45:52.680 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:45:52.686 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:46:22.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:46:22.818 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:46:22.821 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:46:52.881 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:46:52.885 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:46:52.888 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:47:23.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:47:23.062 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:47:23.065 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:47:53.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:47:53.218 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:47:53.221 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:48:23.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:48:23.361 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:48:23.365 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:48:53.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:48:53.515 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:48:53.518 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:49:23.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:49:23.687 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:49:23.692 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:49:53.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:49:53.882 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:49:53.893 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:50:24.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:50:24.032 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:50:24.038 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:50:54.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:50:54.189 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:50:54.192 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:51:24.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:51:24.289 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:51:24.293 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:51:54.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:51:54.458 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:51:54.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:52:24.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:52:24.527 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:52:24.531 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:52:54.678 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:52:54.684 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:52:54.690 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:53:24.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:53:24.766 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:53:24.771 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:53:54.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:53:54.911 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:53:54.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:54:25.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:54:25.222 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:54:25.227 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:54:55.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:54:55.288 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:54:55.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:55:25.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:55:25.476 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:55:25.480 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:55:55.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:55:55.545 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:55:55.548 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:56:25.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:56:25.636 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:56:25.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:56:55.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:56:55.712 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:56:55.717 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:57:25.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:57:25.863 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:57:25.866 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:57:55.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:57:56.000 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:57:56.004 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:58:26.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:58:26.084 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:58:26.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:58:56.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:58:56.234 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:58:56.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:59:26.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:59:26.370 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:59:26.374 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:59:56.520 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:59:56.526 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T12:59:56.530 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:00:26.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:00:26.675 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:00:26.690 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:00:56.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:00:56.849 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:00:56.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:01:27.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:01:27.018 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:01:27.024 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:01:57.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:01:57.183 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:01:57.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:02:27.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:02:27.268 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:02:27.272 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:02:57.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:02:57.426 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:02:57.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:03:27.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:03:27.540 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:03:27.544 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:03:57.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:03:57.687 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:03:57.691 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:04:27.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:04:27.834 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:04:27.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:04:57.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:04:57.995 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:04:57.997 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:05:28.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:05:28.147 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:05:28.150 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:05:58.287 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:05:58.291 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:05:58.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:06:28.404 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:06:28.411 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:06:28.418 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:06:58.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:06:58.513 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:06:58.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:07:28.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:07:28.643 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:07:28.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:07:58.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:07:58.788 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:07:58.791 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:08:28.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:08:28.930 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:08:28.932 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:08:59.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:08:59.064 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:08:59.068 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:09:29.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:09:29.194 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:09:29.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:09:59.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:09:59.271 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:09:59.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:10:29.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:10:29.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:10:29.403 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:10:59.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:10:59.522 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:10:59.526 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:11:29.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:11:29.712 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:11:29.715 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:11:59.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:11:59.840 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:11:59.844 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:12:30.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:12:30.142 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:12:30.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:13:00.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:13:00.280 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:13:00.282 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:13:30.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:13:30.394 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:13:30.397 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:14:00.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:14:00.550 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:14:00.553 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:14:30.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:14:30.702 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:14:30.705 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:15:00.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:15:00.882 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:15:00.885 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:15:31.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:15:31.004 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:15:31.007 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:16:01.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:16:01.158 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:16:01.161 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:16:31.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:16:31.299 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:16:31.303 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:17:01.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:17:01.441 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:17:01.444 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:17:31.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:17:31.547 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:17:31.550 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:18:01.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:18:01.691 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:18:01.694 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:18:31.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:18:31.832 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:18:31.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:19:01.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:19:01.965 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:19:01.968 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:19:32.113 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:19:32.117 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:19:32.120 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:20:02.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:20:02.265 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:20:02.268 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:20:32.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:20:32.403 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:20:32.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:21:02.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:21:02.636 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:21:02.642 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:21:32.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:21:32.724 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:21:32.729 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:22:02.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:22:02.864 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:22:02.867 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:22:32.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:22:32.999 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:22:33.063 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:23:03.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:23:03.197 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:23:03.209 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:23:33.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:23:33.327 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:23:33.332 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:24:03.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:24:03.466 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:24:03.469 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:24:33.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:24:33.619 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:24:33.623 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:25:03.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:25:03.769 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:25:03.773 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:25:34.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:25:34.037 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:25:34.042 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:26:04.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:26:04.197 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:26:04.200 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:26:34.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:26:34.344 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:26:34.347 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:27:04.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:27:04.507 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:27:04.511 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:27:34.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:27:34.639 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:27:34.657 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:28:04.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:28:04.775 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:28:04.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:28:34.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:28:34.925 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:28:34.930 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:29:05.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:29:05.063 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:29:05.066 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:29:35.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:29:35.210 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:29:35.214 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:30:05.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:30:05.356 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:30:05.360 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:30:35.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:30:35.446 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:30:35.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:31:05.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:31:05.575 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:31:05.579 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:31:35.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:31:35.697 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:31:35.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:32:05.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:32:05.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:32:05.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:32:35.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:32:35.998 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:32:36.002 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:33:06.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:33:06.096 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:33:06.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:33:36.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:33:36.247 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:33:36.251 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:34:06.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:34:06.391 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:34:06.396 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:34:36.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:34:36.549 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:34:36.553 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:35:06.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:35:06.679 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:35:06.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:35:36.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:35:36.834 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:35:36.838 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:36:06.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:36:06.997 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:36:07.000 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:36:37.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:36:37.152 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:36:37.155 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:37:07.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:37:07.297 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:37:07.302 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:37:37.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:37:37.416 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:37:37.427 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:38:07.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:38:07.570 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:38:07.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:38:37.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:38:37.727 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:38:37.731 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:39:07.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:39:07.802 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:39:07.819 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:39:37.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:39:37.906 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:39:37.909 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:40:08.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:40:08.026 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:40:08.029 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:40:38.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:40:38.184 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:40:38.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:41:08.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:41:08.266 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:41:08.272 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:41:38.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:41:38.342 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:41:38.345 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:42:08.490 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:42:08.495 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:42:08.499 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:42:38.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:42:38.625 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:42:38.629 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:43:08.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:43:08.755 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:43:08.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:43:38.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:43:38.823 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:43:38.829 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:44:08.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:44:08.909 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:44:08.913 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:44:39.036 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:44:39.041 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:44:39.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:45:09.113 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:45:09.118 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:45:09.121 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:45:39.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:45:39.259 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:45:39.262 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:46:09.391 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:46:09.397 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:46:09.411 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:46:39.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:46:39.571 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:46:39.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:47:09.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:47:09.658 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:47:09.662 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:47:39.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:47:39.807 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:47:39.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:48:09.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:48:09.910 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:48:09.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:48:39.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:48:39.999 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:48:40.002 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:49:10.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:49:10.165 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:49:10.168 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:49:40.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:49:40.336 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:49:40.340 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:50:10.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:50:10.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:50:10.403 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:50:40.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:50:40.539 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:50:40.542 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:51:10.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:51:10.652 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:51:10.655 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:51:40.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:51:40.807 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:51:40.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:52:10.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:52:10.921 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:52:10.924 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:52:41.001 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:52:41.005 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:52:41.008 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:53:11.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:53:11.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:53:11.077 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:53:41.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:53:41.224 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:53:41.227 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:54:11.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:54:11.380 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:54:11.383 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:54:41.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:54:41.516 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:54:41.519 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:55:11.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:55:11.666 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:55:11.669 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:55:41.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:55:41.822 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:55:41.825 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:56:11.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:56:11.969 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:56:11.972 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:56:42.113 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:56:42.118 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:56:42.121 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:57:12.321 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:57:12.325 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:57:12.329 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:57:42.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:57:42.394 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:57:42.400 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:58:12.529 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:58:12.534 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:58:12.538 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:58:42.602 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:58:42.606 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:58:42.610 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:59:12.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:59:12.804 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:59:12.807 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:59:42.881 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:59:42.885 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T13:59:42.888 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:00:12.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:00:12.970 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:00:12.974 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:00:43.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:00:43.123 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:00:43.126 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:01:13.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:01:13.187 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:01:13.192 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:01:43.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:01:43.263 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:01:43.266 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:02:13.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:02:13.414 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:02:13.418 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:02:43.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:02:43.500 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:02:43.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:03:13.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:03:13.658 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:03:13.661 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:03:43.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:03:43.807 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:03:43.812 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:04:13.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:04:13.905 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:04:13.909 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:04:44.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:04:44.066 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:04:44.070 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:05:14.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:05:14.151 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:05:14.154 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:05:44.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:05:44.423 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:05:44.426 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:06:14.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:06:14.511 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:06:14.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:06:44.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:06:44.624 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:06:44.627 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:07:14.718 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:07:14.742 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:07:14.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:07:44.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:07:44.895 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:07:44.899 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:08:14.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:08:14.983 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:08:14.986 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:08:45.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:08:45.064 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:08:45.068 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:09:15.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:09:15.280 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:09:15.283 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:09:45.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:09:45.423 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:09:45.426 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:10:15.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:10:15.495 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:10:15.500 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:10:45.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:10:45.627 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:10:45.631 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:11:15.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:11:15.785 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:11:15.788 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:11:45.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:11:45.924 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:11:45.926 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:12:15.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:12:15.988 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:12:15.992 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:12:46.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:12:46.102 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:12:46.105 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:13:16.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:13:16.234 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:13:16.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:13:46.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:13:46.388 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:13:46.392 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:14:16.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:14:16.455 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:14:16.460 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:14:46.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:14:46.574 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:14:46.578 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:15:16.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:15:16.738 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:15:16.741 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:15:46.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:15:46.870 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:15:46.874 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:16:17.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:16:17.008 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:16:17.012 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:16:47.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:16:47.079 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:16:47.082 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:17:17.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:17:17.151 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:17:17.155 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:17:47.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:17:47.285 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:17:47.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:18:17.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:18:17.425 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:18:17.430 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:18:47.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:18:47.524 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:18:47.528 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:19:17.678 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:19:17.692 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:19:17.696 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:19:47.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:19:47.838 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:19:47.841 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:20:17.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:20:17.972 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:20:17.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:20:48.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:20:48.116 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:20:48.121 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:21:18.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:21:18.271 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:21:18.276 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:21:48.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:21:48.345 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:21:48.349 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:22:18.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:22:18.508 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:22:18.511 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:22:48.636 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:22:48.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:22:48.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:23:18.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:23:18.959 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:23:18.964 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:23:49.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:23:49.040 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:23:49.043 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:24:19.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:24:19.166 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:24:19.171 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:24:49.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:24:49.355 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:24:49.362 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:25:19.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:25:19.533 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:25:19.537 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:25:49.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:25:49.668 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:25:49.675 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:26:19.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:26:19.841 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:26:19.844 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:26:49.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:26:49.999 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:26:50.003 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:27:20.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:27:20.113 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:27:20.116 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:27:50.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:27:50.290 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:27:50.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:28:20.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:28:20.361 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:28:20.365 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:28:50.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:28:50.551 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:28:50.555 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:29:20.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:29:20.708 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:29:20.712 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:29:50.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:29:50.877 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:29:50.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:30:21.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:30:21.026 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:30:21.031 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:30:51.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:30:51.175 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:30:51.178 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:31:21.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:31:21.303 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:31:21.306 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:31:51.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:31:51.442 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:31:51.445 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:32:21.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:32:21.604 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:32:21.607 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:32:51.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:32:51.742 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:32:51.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:33:21.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:33:21.879 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:33:21.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:33:52.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:33:52.095 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:33:52.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:34:22.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:34:22.163 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:34:22.168 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:34:52.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:34:52.325 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:34:52.329 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:35:22.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:35:22.471 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:35:22.474 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:35:52.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:35:52.617 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:35:52.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:36:22.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:36:22.784 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:36:22.790 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:36:52.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:36:52.858 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:36:52.861 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:37:23.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:37:23.010 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:37:23.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:37:53.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:37:53.229 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:37:53.232 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:38:23.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:38:23.294 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:38:23.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:38:53.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:38:53.442 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:38:53.445 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:39:23.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:39:23.515 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:39:23.530 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:39:53.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:39:53.640 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:39:53.644 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:40:23.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:40:23.795 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:40:23.798 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:40:53.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:40:53.910 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:40:53.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:41:24.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:41:24.056 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:41:24.059 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:41:54.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:41:54.185 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:41:54.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:42:24.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:42:24.318 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:42:24.320 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:42:54.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:42:54.444 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:42:54.447 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:43:24.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:43:24.546 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:43:24.549 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:43:54.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:43:54.697 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:43:54.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:44:24.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:44:24.832 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:44:24.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:44:54.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:44:54.959 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:44:54.963 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:45:25.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:45:25.128 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:45:25.132 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:45:55.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:45:55.278 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:45:55.282 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:46:25.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:46:25.399 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:46:25.402 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:46:55.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:46:55.538 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:46:55.542 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:47:25.689 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:47:25.695 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:47:25.699 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:47:55.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:47:55.818 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:47:55.821 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:48:25.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:48:25.974 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:48:25.979 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:48:56.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:48:56.072 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:48:56.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:49:26.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:49:26.209 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:49:26.213 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:49:56.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:49:56.359 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:49:56.362 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:50:26.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:50:26.567 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:50:26.571 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:50:56.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:50:56.721 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:50:56.724 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:51:26.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:51:26.932 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:51:26.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:51:57.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:51:57.098 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:51:57.105 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:52:27.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:52:27.188 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:52:27.204 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:52:57.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:52:57.379 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:52:57.384 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:53:27.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:53:27.547 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:53:27.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:53:57.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:53:57.729 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:53:57.734 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:54:27.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:54:27.860 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:54:27.863 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:54:57.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:54:57.997 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:54:58.001 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:55:28.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:55:28.108 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:55:28.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:55:58.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:55:58.244 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:55:58.247 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:56:28.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:56:28.423 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:56:28.427 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:56:58.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:56:58.501 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:56:58.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:57:28.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:57:28.644 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:57:28.647 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:57:58.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:57:58.765 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:57:58.768 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:58:28.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:58:28.877 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:58:28.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:58:59.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:58:59.023 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:58:59.027 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:59:29.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:59:29.155 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:59:29.158 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:59:59.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:59:59.311 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T14:59:59.316 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:00:29.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:00:29.567 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:00:29.571 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:00:59.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:00:59.631 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:00:59.636 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:01:29.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:01:29.770 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:01:29.774 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:01:59.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:01:59.916 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:01:59.919 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:02:30.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:02:30.057 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:02:30.061 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:03:00.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:03:00.198 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:03:00.202 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:03:30.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:03:30.277 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:03:30.281 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:04:00.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:04:00.429 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:04:00.432 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:04:30.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:04:30.573 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:04:30.576 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:05:00.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:05:00.735 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:05:00.738 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:05:30.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:05:30.883 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:05:30.886 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:06:01.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:06:01.011 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:06:01.014 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:06:31.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:06:31.133 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:06:31.136 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:07:01.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:07:01.290 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:07:01.293 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:07:31.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:07:31.360 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:07:31.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:08:01.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:08:01.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:08:01.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:08:31.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:08:31.617 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:08:31.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:09:01.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:09:01.764 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:09:01.767 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:09:31.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:09:31.879 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:09:31.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:10:02.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:10:02.051 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:10:02.055 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:10:32.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:10:32.196 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:10:32.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:11:02.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:11:02.346 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:11:02.349 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:11:32.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:11:32.498 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:11:32.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:12:02.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:12:02.634 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:12:02.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:12:32.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:12:32.761 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:12:32.765 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:13:02.910 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:13:02.914 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:13:02.917 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:13:33.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:13:33.031 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:13:33.034 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:14:03.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:14:03.169 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:14:03.172 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:14:33.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:14:33.235 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:14:33.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:15:03.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:15:03.414 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:15:03.417 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:15:33.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:15:33.527 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:15:33.530 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:16:03.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:16:03.590 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:16:03.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:16:33.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:16:33.906 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:16:33.908 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:17:03.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:17:03.975 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:17:03.978 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:17:34.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:17:34.093 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:17:34.096 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:18:04.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:18:04.213 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:18:04.218 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:18:34.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:18:34.296 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:18:34.299 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:19:04.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:19:04.433 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:19:04.438 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:19:34.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:19:34.507 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:19:34.511 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:20:04.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:20:04.625 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:20:04.628 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:20:34.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:20:34.760 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:20:34.765 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:21:04.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:21:04.923 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:21:04.927 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:21:35.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:21:35.062 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:21:35.064 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:22:05.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:22:05.194 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:22:05.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:22:35.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:22:35.343 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:22:35.346 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:23:05.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:23:05.438 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:23:05.442 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:23:35.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:23:35.528 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:23:35.532 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:24:05.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:24:05.674 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:24:05.677 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:24:35.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:24:35.770 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:24:35.773 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:25:05.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:25:05.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:25:05.854 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:25:36.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:25:36.007 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:25:36.010 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:26:06.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:26:06.089 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:26:06.094 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:26:36.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:26:36.204 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:26:36.208 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:27:06.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:27:06.372 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:27:06.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:27:36.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:27:36.523 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:27:36.527 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:28:06.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:28:06.679 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:28:06.683 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:28:36.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:28:36.801 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:28:36.804 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:29:06.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:29:06.935 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:29:06.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:29:37.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:29:37.071 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:29:37.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:30:07.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:30:07.211 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:30:07.214 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:30:37.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:30:37.366 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:30:37.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:31:07.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:31:07.632 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:31:07.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:31:37.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:31:37.706 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:31:37.709 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:32:07.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:32:07.861 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:32:07.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:32:38.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:32:38.016 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:32:38.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:33:08.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:33:08.102 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:33:08.116 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:33:38.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:33:38.272 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:33:38.275 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:34:08.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:34:08.426 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:34:08.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:34:38.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:34:38.499 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:34:38.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:35:08.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:35:08.651 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:35:08.654 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:35:38.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:35:38.725 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:35:38.728 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:36:08.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:36:08.857 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:36:08.861 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:36:38.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:36:38.964 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:36:38.967 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:37:09.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:37:09.094 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:37:09.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:37:39.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:37:39.216 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:37:39.219 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:38:09.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:38:09.382 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:38:09.389 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:38:39.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:38:39.479 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:38:39.483 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:39:09.602 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:39:09.608 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:39:09.612 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:39:39.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:39:39.704 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:39:39.713 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:40:09.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:40:09.789 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:40:09.792 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:40:39.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:40:39.943 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:40:39.946 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:41:10.081 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:41:10.085 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:41:10.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:41:40.205 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:41:40.214 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:41:40.218 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:42:10.446 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:42:10.449 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:42:10.453 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:42:40.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:42:40.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:42:40.565 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:43:10.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:43:10.710 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:43:10.718 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:43:40.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:43:40.876 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:43:40.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:44:11.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:44:11.022 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:44:11.025 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:44:41.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:44:41.090 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:44:41.094 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:45:11.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:45:11.235 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:45:11.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:45:41.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:45:41.378 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:45:41.384 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:46:11.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:46:11.539 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:46:11.547 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:46:41.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:46:41.682 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:46:41.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:47:11.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:47:11.809 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:47:11.816 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:47:41.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:47:41.900 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:47:41.904 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:48:12.122 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:48:12.126 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:48:12.130 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:48:42.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:48:42.198 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:48:42.201 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:49:12.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:49:12.362 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:49:12.366 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:49:42.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:49:42.494 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:49:42.497 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:50:12.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:50:12.571 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:50:12.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:50:42.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:50:42.832 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:50:42.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:51:12.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:51:12.944 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:51:12.947 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:51:43.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:51:43.033 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:51:43.036 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:52:13.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:52:13.240 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:52:13.251 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:52:43.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:52:43.322 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:52:43.325 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:53:13.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:53:13.466 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:53:13.469 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:53:43.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:53:43.556 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:53:43.559 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:54:13.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:54:13.673 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:54:13.677 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:54:43.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:54:43.766 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:54:43.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:55:13.908 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:55:13.912 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:55:13.916 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:55:44.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:55:44.048 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:55:44.052 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:56:14.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:56:14.163 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:56:14.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:56:44.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:56:44.319 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:56:44.322 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:57:14.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:57:14.475 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:57:14.479 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:57:44.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:57:44.584 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:57:44.592 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:58:14.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:58:14.766 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:58:14.769 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:58:44.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:58:44.902 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:58:44.905 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:59:15.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:59:15.041 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:59:15.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:59:45.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:59:45.169 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T15:59:45.180 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:00:15.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:00:15.316 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:00:15.325 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:00:45.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:00:45.483 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:00:45.487 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:01:15.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:01:15.646 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:01:15.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:01:45.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:01:45.787 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:01:45.792 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:02:15.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:02:15.936 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:02:15.940 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:02:46.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:02:46.052 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:02:46.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:03:16.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:03:16.158 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:03:16.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:03:46.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:03:46.307 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:03:46.310 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:04:16.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:04:16.423 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:04:16.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:04:46.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:04:46.599 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:04:46.603 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:05:16.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:05:16.751 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:05:16.761 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:05:46.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:05:46.893 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:05:46.897 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:06:17.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:06:17.013 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:06:17.016 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:06:47.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:06:47.144 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:06:47.147 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:07:17.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:07:17.234 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:07:17.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:07:47.393 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:07:47.399 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:07:47.402 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:08:17.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:08:17.545 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:08:17.548 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:08:47.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:08:47.661 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:08:47.664 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:09:17.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:09:17.790 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:09:17.793 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:09:47.951 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:09:47.957 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:09:47.961 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:10:18.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:10:18.035 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:10:18.038 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:10:48.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:10:48.159 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:10:48.163 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:11:18.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:11:18.305 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:11:18.309 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:11:48.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:11:48.385 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:11:48.389 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:12:18.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:12:18.551 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:12:18.555 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:12:48.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:12:48.700 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:12:48.703 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:13:18.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:13:18.784 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:13:18.788 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:13:48.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:13:48.930 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:13:48.933 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:14:19.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:14:19.087 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:14:19.090 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:14:49.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:14:49.215 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:14:49.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:15:19.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:15:19.350 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:15:19.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:15:49.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:15:49.506 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:15:49.510 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:16:19.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:16:19.637 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:16:19.646 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:16:49.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:16:49.806 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:16:49.814 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:17:19.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:17:19.975 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:17:19.980 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:17:50.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:17:50.091 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:17:50.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:18:20.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:18:20.280 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:18:20.293 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:18:50.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:18:50.401 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:18:50.405 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:19:20.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:19:20.535 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:19:20.540 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:19:50.674 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:19:50.687 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:19:50.694 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:20:20.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:20:20.843 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:20:20.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:20:51.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:20:51.018 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:20:51.024 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:21:21.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:21:21.216 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:21:21.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:21:51.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:21:51.414 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:21:51.419 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:22:21.476 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:22:21.486 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:22:21.490 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:22:51.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:22:51.655 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:22:51.658 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:23:21.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:23:21.818 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:23:21.821 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:23:51.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:23:51.972 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:23:51.975 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:24:22.113 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:24:22.117 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:24:22.120 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:24:52.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:24:52.258 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:24:52.261 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:25:22.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:25:22.401 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:25:22.405 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:25:52.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:25:52.490 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:25:52.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:26:22.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:26:22.654 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:26:22.656 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:26:52.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:26:52.796 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:26:52.799 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:27:22.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:27:22.876 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:27:22.879 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:27:52.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:27:52.955 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:27:52.959 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:28:23.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:28:23.032 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:28:23.036 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:28:53.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:28:53.102 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:28:53.108 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:29:23.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:29:23.258 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:29:23.263 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:29:53.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:29:53.395 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:29:53.398 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:30:23.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:30:23.496 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:30:23.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:30:53.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:30:53.632 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:30:53.647 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:31:23.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:31:23.855 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:31:23.879 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:31:54.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:31:54.024 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:31:54.051 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:32:24.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:32:24.133 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:32:24.136 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:32:54.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:32:54.264 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:32:54.285 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:33:24.401 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:33:24.409 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:33:24.442 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:33:54.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:33:54.576 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:33:54.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:34:24.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:34:24.748 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:34:24.759 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:34:54.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:34:54.829 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:34:54.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:35:24.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:35:24.940 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:35:24.945 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:35:55.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:35:55.079 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:35:55.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:36:25.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:36:25.149 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:36:25.155 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:36:55.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:36:55.260 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:36:55.267 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:37:25.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:37:25.418 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:37:25.424 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:37:55.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:37:55.516 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:37:55.522 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:38:25.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:38:25.691 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:38:25.701 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:38:55.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:38:55.840 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:38:55.845 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:39:25.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:39:26.020 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:39:26.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:39:56.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:39:56.181 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:39:56.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:40:26.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:40:26.372 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:40:26.378 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:40:56.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:40:56.477 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:40:56.482 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:41:26.636 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:41:26.645 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:41:26.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:41:56.718 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:41:56.738 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:41:56.743 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:42:26.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:42:26.827 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:42:26.832 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:42:56.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:42:56.922 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:42:56.935 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:43:27.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:43:27.067 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:43:27.070 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:43:57.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:43:57.224 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:43:57.227 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:44:27.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:44:27.385 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:44:27.388 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:44:57.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:44:57.499 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:44:57.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:45:27.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:45:27.662 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:45:27.665 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:45:57.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:45:57.724 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:45:57.727 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:46:27.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:46:27.789 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:46:27.792 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:46:57.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:46:57.930 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:46:57.934 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:47:28.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:47:28.051 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:47:28.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:47:58.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:47:58.182 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:47:58.185 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:48:28.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:48:28.286 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:48:28.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:48:58.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:48:58.425 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:48:58.427 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:49:28.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:49:28.505 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:49:28.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:49:58.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:49:58.619 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:49:58.622 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:50:28.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:50:28.736 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:50:28.740 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:50:58.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:50:58.857 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:50:58.861 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:51:28.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:51:28.928 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:51:28.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:51:59.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:51:59.009 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:51:59.012 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:52:29.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:52:29.073 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:52:29.076 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:52:59.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:52:59.218 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:52:59.221 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:53:29.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:53:29.340 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:53:29.343 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:53:59.459 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:53:59.463 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:53:59.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:54:29.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:54:29.618 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:54:29.621 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:54:59.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:54:59.731 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:54:59.734 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:55:29.891 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:55:29.895 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:55:29.898 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:55:59.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:55:59.961 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:55:59.964 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:56:30.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:56:30.098 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:56:30.100 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:57:00.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:57:00.178 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:57:00.181 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:57:30.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:57:30.318 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:57:30.322 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:58:00.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:58:00.384 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:58:00.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:58:30.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:58:30.448 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:58:30.451 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:59:00.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:59:00.582 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:59:00.585 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:59:30.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:59:30.731 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T16:59:30.736 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:00:00.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:00:00.869 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:00:00.872 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:00:31.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:00:31.017 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:00:31.020 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:01:01.163 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:01:01.167 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:01:01.170 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:01:31.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:01:31.312 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:01:31.315 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:02:01.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:02:01.446 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:02:01.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:02:31.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:02:31.569 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:02:31.573 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:03:01.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:03:01.729 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:03:01.733 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:03:31.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:03:31.867 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:03:31.870 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:04:02.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:04:02.018 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:04:02.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:04:32.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:04:32.086 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:04:32.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:05:02.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:05:02.228 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:05:02.231 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:05:32.296 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:05:32.300 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:05:32.303 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:06:02.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:06:02.535 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:06:02.538 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:06:32.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:06:32.828 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:06:32.831 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:07:02.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:07:02.890 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:07:02.893 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:07:33.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:07:33.048 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:07:33.051 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:08:03.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:08:03.128 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:08:03.135 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:08:33.279 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:08:33.283 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:08:33.287 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:09:03.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:09:03.365 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:09:03.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:09:33.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:09:33.662 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:09:33.665 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:10:03.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:10:03.731 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:10:03.734 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:10:33.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:10:33.889 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:10:33.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:11:04.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:11:04.217 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:11:04.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:11:34.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:11:34.289 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:11:34.292 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:12:04.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:12:04.440 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:12:04.443 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:12:34.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:12:34.571 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:12:34.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:13:04.718 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:13:04.722 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:13:04.725 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:13:34.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:13:34.873 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:13:34.876 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:14:04.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:14:04.957 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:14:04.961 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:14:35.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:14:35.101 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:14:35.104 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:15:05.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:15:05.239 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:15:05.242 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:15:35.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:15:35.490 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:15:35.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:16:05.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:16:05.578 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:16:05.581 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:16:35.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:16:35.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:16:35.717 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:17:05.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:17:05.853 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:17:05.856 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:17:35.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:17:35.995 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:17:35.998 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:18:06.136 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:18:06.140 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:18:06.143 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:18:36.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:18:36.437 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:18:36.440 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:19:06.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:19:06.529 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:19:06.533 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:19:36.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:19:36.641 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:19:36.644 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:20:06.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:20:06.890 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:20:06.894 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:20:36.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:20:36.961 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:20:36.964 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:21:07.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:21:07.050 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:21:07.053 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:21:37.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:21:37.206 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:21:37.209 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:22:07.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:22:07.380 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:22:07.384 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:22:37.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:22:37.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:22:37.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:23:07.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:23:07.582 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:23:07.585 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:23:37.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:23:37.720 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:23:37.723 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:24:07.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:24:07.868 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:24:07.870 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:24:38.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:24:38.006 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:24:38.009 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:25:08.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:25:08.145 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:25:08.148 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:25:38.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:25:38.293 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:25:38.296 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:26:08.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:26:08.381 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:26:08.406 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:26:38.533 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:26:38.537 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:26:38.540 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:27:08.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:27:08.610 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:27:08.613 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:27:38.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:27:38.757 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:27:38.760 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:28:08.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:28:08.888 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:28:08.890 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:28:39.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:28:39.018 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:28:39.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:29:09.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:29:09.083 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:29:09.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:29:39.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:29:39.147 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:29:39.150 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:30:09.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:30:09.276 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:30:09.279 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:30:39.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:30:39.383 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:30:39.386 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:31:09.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:31:09.496 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:31:09.499 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:31:39.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:31:39.644 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:31:39.647 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:32:09.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:32:09.782 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:32:09.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:32:39.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:32:39.929 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:32:39.932 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:33:10.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:33:10.043 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:33:10.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:33:40.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:33:40.148 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:33:40.151 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:34:10.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:34:10.303 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:34:10.306 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:34:40.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:34:40.451 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:34:40.454 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:35:10.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:35:10.514 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:35:10.517 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:35:40.657 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:35:40.661 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:35:40.664 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:36:10.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:36:10.783 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:36:10.786 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:36:40.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:36:40.940 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:36:40.943 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:37:11.025 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:37:11.029 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:37:11.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:37:41.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:37:41.152 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:37:41.155 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:38:11.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:38:11.224 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:38:11.227 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:38:41.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:38:41.346 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:38:41.349 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:39:11.481 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:39:11.485 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:39:11.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:39:41.586 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:39:41.590 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:39:41.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:40:11.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:40:11.746 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:40:11.749 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:40:41.881 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:40:41.885 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:40:41.888 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:41:12.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:41:12.023 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:41:12.026 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:41:42.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:41:42.162 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:41:42.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:42:12.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:42:12.310 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:42:12.313 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:42:42.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:42:42.450 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:42:42.453 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:43:12.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:43:12.571 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:43:12.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:43:42.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:43:42.701 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:43:42.704 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:44:12.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:44:12.798 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:44:12.801 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:44:42.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:44:42.937 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:44:42.939 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:45:13.122 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:45:13.126 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:45:13.128 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:45:43.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:45:43.256 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:45:43.259 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:46:13.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:46:13.396 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:46:13.399 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:46:43.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:46:43.459 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:46:43.462 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:47:13.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:47:13.524 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:47:13.528 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:47:43.586 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:47:43.591 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:47:43.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:48:13.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:48:13.665 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:48:13.668 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:48:43.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:48:43.767 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:48:43.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:49:13.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:49:13.924 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:49:13.926 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:49:44.037 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:49:44.041 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:49:44.044 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:50:14.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:50:14.167 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:50:14.170 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:50:44.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:50:44.327 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:50:44.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:51:14.404 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:51:14.408 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:51:14.411 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:51:44.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:51:44.560 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:51:44.564 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:52:14.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:52:14.676 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:52:14.680 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:52:44.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:52:44.812 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:52:44.816 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:53:15.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:53:15.163 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:53:15.168 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:53:45.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:53:45.327 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:53:45.331 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:54:15.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:54:15.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:54:15.404 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:54:45.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:54:45.474 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:54:45.477 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:55:15.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:55:15.597 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:55:15.600 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:55:45.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:55:45.778 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:55:45.781 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:56:15.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:56:15.862 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:56:15.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:56:45.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:56:45.931 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:56:45.934 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:57:15.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:57:16.002 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:57:16.006 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:57:46.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:57:46.080 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:57:46.083 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:58:16.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:58:16.157 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:58:16.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:58:46.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:58:46.222 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:58:46.225 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:59:16.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:59:16.303 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:59:16.306 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:59:46.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:59:46.372 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T17:59:46.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:00:16.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:00:16.485 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:00:16.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:00:46.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:00:46.667 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:00:46.670 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:01:16.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:01:16.797 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:01:16.801 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:01:46.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:01:46.954 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:01:46.957 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:02:17.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:02:17.017 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:02:17.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:02:47.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:02:47.089 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:02:47.093 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:03:17.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:03:17.155 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:03:17.158 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:03:47.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:03:47.232 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:03:47.234 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:04:17.301 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:04:17.305 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:04:17.308 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:04:47.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:04:47.371 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:04:47.374 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:05:17.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:05:17.442 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:05:17.445 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:05:47.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:05:47.516 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:05:47.519 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:06:17.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:06:17.589 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:06:17.592 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:06:47.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:06:47.666 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:06:47.669 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:07:17.745 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:07:17.749 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:07:17.751 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:07:47.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:07:47.830 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:07:47.833 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:08:17.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:08:17.904 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:08:17.909 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:08:47.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:08:47.985 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:08:47.988 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:09:18.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:09:18.048 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:09:18.051 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:09:48.110 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:09:48.114 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:09:48.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:10:18.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:10:18.186 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:10:18.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:10:48.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:10:48.277 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:10:48.280 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:11:18.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:11:18.358 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:11:18.361 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:11:48.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:11:48.437 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:11:48.440 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:12:18.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:12:18.501 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:12:18.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:12:48.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:12:48.557 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:12:48.560 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:13:18.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:13:18.622 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:13:18.625 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:13:48.689 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:13:48.693 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:13:48.696 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:14:18.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:14:18.774 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:14:18.777 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:14:48.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:14:48.863 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:14:48.866 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:15:18.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:15:18.929 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:15:18.932 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:15:48.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:15:48.999 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:15:49.002 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:16:19.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:16:19.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:16:19.077 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:16:49.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:16:49.139 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:16:49.142 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:17:19.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:17:19.219 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:17:19.222 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:17:49.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:17:49.293 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:17:49.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:18:19.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:18:19.366 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:18:19.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:18:49.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:18:49.439 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:18:49.443 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:19:19.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:19:19.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:19:19.522 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:19:49.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:19:49.602 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:19:49.606 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:20:19.679 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:20:19.684 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:20:19.688 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:20:49.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:20:49.753 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:20:49.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:21:19.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:21:19.822 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:21:19.825 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:21:49.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:21:49.903 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:21:49.906 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:22:19.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:22:19.973 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:22:19.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:22:50.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:22:50.132 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:22:50.135 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:23:20.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:23:20.254 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:23:20.257 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:23:50.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:23:50.384 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:23:50.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:24:20.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:24:20.531 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:24:20.534 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:24:50.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:24:50.628 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:24:50.631 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:25:20.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:25:20.779 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:25:20.782 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:25:50.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:25:50.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:25:50.929 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:26:21.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:26:21.069 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:26:21.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:26:51.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:26:51.234 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:26:51.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:27:21.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:27:21.327 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:27:21.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:27:51.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:27:51.469 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:27:51.472 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:28:21.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:28:21.643 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:28:21.646 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:28:51.777 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:28:51.781 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:28:51.784 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:29:21.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:29:21.928 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:29:21.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:29:52.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:29:52.142 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:29:52.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:30:22.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:30:22.207 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:30:22.210 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:30:52.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:30:52.295 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:30:52.299 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:31:22.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:31:22.418 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:31:22.421 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:31:52.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:31:52.572 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:31:52.576 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:32:22.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:32:22.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:32:22.645 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:32:52.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:32:52.775 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:32:52.779 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:33:22.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:33:22.838 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:33:22.842 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:33:52.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:33:52.977 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:33:52.981 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:34:23.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:34:23.058 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:34:23.061 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:34:53.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:34:53.205 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:34:53.208 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:35:23.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:35:23.318 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:35:23.321 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:35:53.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:35:53.442 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:35:53.445 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:36:23.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:36:24.048 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:36:24.052 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:36:54.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:36:54.119 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:36:54.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:37:24.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:37:24.192 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:37:24.194 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:37:54.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:37:54.257 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:37:54.260 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:38:24.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:38:24.334 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:38:24.337 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:38:54.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:38:54.412 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:38:54.418 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:39:24.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:39:24.478 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:39:24.482 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:39:54.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:39:54.559 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:39:54.562 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:40:24.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:40:24.629 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:40:24.632 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:40:54.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:40:54.698 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:40:54.704 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:41:24.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:41:24.774 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:41:24.779 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:41:54.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:41:54.850 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:41:54.854 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:42:24.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:42:24.928 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:42:24.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:42:54.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:42:55.001 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:42:55.005 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:43:25.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:43:25.087 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:43:25.090 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:43:55.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:43:55.163 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:43:55.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:44:25.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:44:25.247 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:44:25.250 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:44:55.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:44:55.327 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:44:55.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:45:25.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:45:25.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:45:25.402 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:45:55.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:45:55.466 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:45:55.470 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:46:25.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:46:25.629 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:46:25.633 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:46:55.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:46:55.720 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:46:55.723 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:47:25.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:47:25.802 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:47:25.810 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:47:55.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:47:55.872 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:47:55.875 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:48:26.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:48:26.011 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:48:26.014 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:48:56.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:48:56.141 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:48:56.144 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:49:26.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:49:26.273 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:49:26.276 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:49:56.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:49:56.421 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:49:56.425 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:50:26.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:50:26.548 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:50:26.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:50:56.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:50:56.625 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:50:56.628 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:51:26.745 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:51:26.749 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:51:26.752 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:51:56.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:51:56.888 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:51:56.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:52:26.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:52:26.985 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:52:26.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:52:57.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:52:57.149 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:52:57.153 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:53:27.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:53:27.270 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:53:27.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:53:57.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:53:57.427 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:53:57.431 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:54:27.520 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:54:27.524 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:54:27.527 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:54:57.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:54:57.606 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:54:57.610 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:55:27.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:55:27.698 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:55:27.701 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:55:57.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:55:57.778 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:55:57.782 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:56:27.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:56:27.856 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:56:27.859 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:56:57.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:56:57.935 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:56:57.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:57:28.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:57:28.006 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:57:28.009 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:57:58.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:57:58.070 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:57:58.073 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:58:28.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:58:28.142 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:58:28.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:58:58.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:58:58.216 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:58:58.219 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:59:28.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:59:28.295 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:59:28.298 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:59:58.373 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:59:58.377 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T18:59:58.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:00:28.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:00:28.456 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:00:28.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:00:58.518 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:00:58.529 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:00:58.532 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:01:28.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:01:28.596 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:01:28.599 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:01:58.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:01:58.667 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:01:58.670 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:02:28.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:02:28.780 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:02:28.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:02:58.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:02:58.936 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:02:58.939 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:03:29.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:03:29.080 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:03:29.082 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:03:59.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:03:59.163 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:03:59.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:04:29.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:04:29.302 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:04:29.305 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:04:59.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:04:59.391 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:04:59.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:05:29.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:05:29.546 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:05:29.549 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:05:59.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:05:59.695 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:05:59.698 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:06:29.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:06:29.843 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:06:29.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:06:59.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:06:59.904 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:06:59.907 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:07:30.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:07:30.063 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:07:30.066 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:08:00.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:08:00.184 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:08:00.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:08:30.260 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:08:30.265 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:08:30.269 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:09:00.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:09:00.412 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:09:00.415 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:09:30.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:09:30.488 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:09:30.490 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:10:00.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:10:00.548 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:10:00.552 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:10:30.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:10:30.617 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:10:30.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:11:00.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:11:00.684 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:11:00.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:11:30.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:11:30.755 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:11:30.759 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:12:00.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:12:00.838 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:12:00.842 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:12:30.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:12:30.928 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:12:30.933 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:13:00.997 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:13:01.001 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:13:01.005 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:13:31.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:13:31.096 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:13:31.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:14:01.163 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:14:01.168 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:14:01.171 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:14:31.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:14:31.232 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:14:31.236 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:15:01.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:15:01.296 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:15:01.299 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:15:31.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:15:31.371 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:15:31.374 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:16:01.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:16:01.433 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:16:01.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:16:31.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:16:31.504 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:16:31.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:17:01.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:17:01.681 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:17:01.684 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:17:31.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:17:31.758 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:17:31.761 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:18:01.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:18:01.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:18:01.890 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:18:31.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:18:32.002 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:18:32.005 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:19:02.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:19:02.125 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:19:02.128 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:19:32.459 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:19:32.463 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:19:32.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:20:02.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:20:02.526 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:20:02.529 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:20:32.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:20:32.608 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:20:32.611 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:21:02.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:21:02.687 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:21:02.691 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:21:32.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:21:32.775 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:21:32.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:22:02.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:22:02.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:22:02.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:22:32.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:22:32.991 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:22:32.994 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:23:03.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:23:03.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:23:03.131 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:23:33.287 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:23:33.291 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:23:33.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:24:03.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:24:03.456 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:24:03.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:24:33.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:24:33.535 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:24:33.538 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:25:03.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:25:03.674 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:25:03.677 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:25:33.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:25:33.780 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:25:33.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:26:03.915 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:26:03.919 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:26:03.922 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:26:34.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:26:34.049 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:26:34.052 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:27:04.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:27:04.204 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:27:04.207 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:27:34.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:27:34.327 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:27:34.329 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:28:04.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:28:04.472 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:28:04.476 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:28:34.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:28:34.627 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:28:34.631 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:29:04.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:29:04.732 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:29:04.735 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:29:34.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:29:34.901 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:29:34.904 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:30:05.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:30:05.046 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:30:05.049 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:30:35.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:30:35.160 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:30:35.163 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:31:05.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:31:05.315 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:31:05.318 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:31:35.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:31:35.451 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:31:35.454 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:32:05.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:32:05.610 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:32:05.613 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:32:35.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:32:35.866 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:32:35.869 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:33:06.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:33:06.020 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:33:06.023 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:33:36.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:33:36.165 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:33:36.170 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:34:06.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:34:06.323 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:34:06.326 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:34:36.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:34:36.455 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:34:36.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:35:06.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:35:06.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:35:06.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:35:36.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:35:36.655 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:35:36.658 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:36:06.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:36:06.769 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:36:06.772 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:36:36.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:36:36.907 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:36:36.910 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:37:07.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:37:07.147 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:37:07.150 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:37:37.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:37:37.250 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:37:37.253 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:38:07.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:38:07.375 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:38:07.379 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:38:37.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:38:37.496 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:38:37.499 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:39:07.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:39:07.625 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:39:07.628 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:39:37.752 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:39:37.756 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:39:37.759 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:40:07.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:40:07.904 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:40:07.906 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:40:38.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:40:38.043 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:40:38.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:41:08.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:41:08.157 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:41:08.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:41:38.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:41:38.288 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:41:38.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:42:08.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:42:08.368 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:42:08.371 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:42:38.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:42:38.515 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:42:38.518 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:43:08.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:43:08.646 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:43:08.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:43:38.782 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:43:38.786 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:43:38.789 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:44:08.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:44:08.941 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:44:08.944 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:44:39.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:44:39.054 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:44:39.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:45:09.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:45:09.185 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:45:09.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:45:39.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:45:39.324 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:45:39.327 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:46:09.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:46:09.438 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:46:09.441 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:46:39.573 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:46:39.577 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:46:39.580 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:47:09.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:47:09.716 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:47:09.719 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:47:39.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:47:39.838 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:47:39.841 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:48:09.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:48:09.986 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:48:09.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:48:40.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:48:40.070 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:48:40.073 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:49:10.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:49:10.238 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:49:10.241 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:49:40.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:49:40.352 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:49:40.355 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:50:10.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:50:10.432 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:50:10.435 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:50:40.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:50:40.497 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:50:40.500 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:51:10.573 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:51:10.577 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:51:10.580 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:51:40.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:51:40.649 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:51:40.652 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:52:10.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:52:10.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:52:10.717 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:52:40.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:52:40.794 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:52:40.797 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:53:10.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:53:10.858 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:53:10.861 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:53:40.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:53:40.925 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:53:40.928 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:54:10.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:54:10.989 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:54:10.992 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:54:41.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:54:41.054 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:54:41.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:55:11.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:55:11.118 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:55:11.121 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:55:41.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:55:41.194 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:55:41.197 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:56:11.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:56:11.260 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:56:11.263 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:56:41.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:56:41.331 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:56:41.334 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:57:11.391 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:57:11.395 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:57:11.398 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:57:41.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:57:41.468 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:57:41.471 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:58:11.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:58:11.532 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:58:11.535 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:58:41.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:58:41.612 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:58:41.615 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:59:11.740 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:59:11.744 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:59:11.747 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:59:41.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:59:41.899 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T19:59:41.902 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:00:11.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:00:11.962 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:00:11.965 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:00:42.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:00:42.093 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:00:42.096 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:01:12.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:01:12.248 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:01:12.251 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:01:42.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:01:42.379 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:01:42.382 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:02:12.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:02:12.518 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:02:12.522 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:02:42.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:02:42.598 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:02:42.601 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:03:12.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:03:12.712 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:03:12.715 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:03:42.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:03:42.834 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:03:42.838 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:04:12.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:04:12.908 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:04:12.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:04:42.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:04:42.986 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:04:42.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:05:13.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:05:13.069 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:05:13.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:05:43.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:05:43.141 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:05:43.144 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:06:13.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:06:13.212 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:06:13.215 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:06:43.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:06:43.285 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:06:43.288 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:07:13.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:07:13.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:07:13.351 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:07:43.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:07:43.421 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:07:43.424 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:08:13.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:08:13.494 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:08:13.497 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:08:43.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:08:43.567 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:08:43.570 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:09:13.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:09:13.646 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:09:13.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:09:43.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:09:43.726 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:09:43.729 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:10:13.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:10:13.791 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:10:13.794 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:10:43.856 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:10:43.860 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:10:43.863 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:11:13.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:11:13.934 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:11:13.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:11:44.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:11:44.009 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:11:44.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:12:14.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:12:14.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:12:14.077 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:12:44.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:12:44.161 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:12:44.164 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:13:14.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:13:14.227 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:13:14.231 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:13:44.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:13:44.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:13:44.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:14:14.480 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:14:14.484 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:14:14.487 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:14:44.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:14:44.616 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:14:44.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:15:14.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:15:14.780 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:15:14.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:15:44.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:15:44.867 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:15:44.870 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:16:14.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:16:14.930 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:16:14.933 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:16:45.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:16:45.054 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:16:45.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:17:15.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:17:15.195 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:17:15.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:17:45.345 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:17:45.349 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:17:45.352 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:18:15.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:18:15.454 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:18:15.457 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:18:45.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:18:45.601 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:18:45.605 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:19:15.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:19:15.779 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:19:15.782 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:19:45.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:19:45.973 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:19:45.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:20:16.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:20:16.055 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:20:16.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:20:46.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:20:46.217 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:20:46.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:21:16.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:21:16.330 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:21:16.332 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:21:46.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:21:46.461 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:21:46.465 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:22:16.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:22:16.608 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:22:16.611 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:22:46.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:22:46.772 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:22:46.775 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:23:16.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:23:16.929 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:23:16.933 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:23:47.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:23:47.024 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:23:47.027 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:24:17.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:24:17.156 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:24:17.159 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:24:47.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:24:47.291 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:24:47.295 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:25:17.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:25:17.437 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:25:17.440 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:25:47.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:25:47.571 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:25:47.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:26:17.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:26:17.726 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:26:17.731 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:26:47.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:26:47.799 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:26:47.803 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:27:17.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:27:17.946 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:27:17.949 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:27:48.081 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:27:48.085 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:27:48.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:28:18.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:28:18.274 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:28:18.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:28:48.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:28:48.344 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:28:48.348 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:29:18.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:29:18.486 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:29:18.489 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:29:48.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:29:48.617 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:29:48.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:30:18.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:30:18.740 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:30:18.745 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:30:48.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:30:48.825 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:30:48.828 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:31:18.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:31:19.003 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:31:19.006 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:31:49.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:31:49.159 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:31:49.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:32:19.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:32:19.239 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:32:19.242 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:32:49.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:32:49.323 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:32:49.326 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:33:19.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:33:19.387 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:33:19.390 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:33:49.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:33:49.534 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:33:49.537 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:34:19.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:34:19.665 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:34:19.667 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:34:49.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:34:49.804 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:34:49.807 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:35:19.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:35:19.885 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:35:19.889 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:35:50.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:35:50.048 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:35:50.051 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:36:20.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:36:20.136 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:36:20.139 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:36:50.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:36:50.258 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:36:50.261 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:37:20.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:37:20.323 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:37:20.326 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:37:50.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:37:50.504 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:37:50.507 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:38:20.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:38:20.651 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:38:20.656 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:38:50.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:38:50.773 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:38:50.776 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:39:20.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:39:20.880 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:39:20.884 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:39:51.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:39:51.025 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:39:51.028 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:40:21.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:40:21.097 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:40:21.100 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:40:51.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:40:51.245 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:40:51.249 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:41:21.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:41:21.343 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:41:21.345 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:41:51.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:41:51.422 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:41:51.425 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:42:21.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:42:21.571 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:42:21.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:42:51.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:42:51.673 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:42:51.676 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:43:21.810 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:43:21.814 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:43:21.816 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:43:51.915 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:43:51.919 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:43:51.922 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:44:22.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:44:22.066 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:44:22.068 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:44:52.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:44:52.221 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:44:52.224 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:45:22.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:45:22.319 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:45:22.321 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:45:52.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:45:52.391 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:45:52.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:46:22.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:46:22.511 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:46:22.514 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:46:52.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:46:52.585 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:46:52.587 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:47:22.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:47:22.707 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:47:22.710 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:47:52.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:47:52.854 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:47:52.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:48:23.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:48:23.009 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:48:23.012 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:48:53.104 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:48:53.109 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:48:53.114 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:49:23.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:49:23.264 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:49:23.267 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:49:53.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:49:53.394 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:49:53.397 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:50:23.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:50:23.543 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:50:23.547 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:50:53.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:50:53.665 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:50:53.668 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:51:23.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:51:23.813 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:51:23.815 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:51:54.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:51:54.063 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:51:54.069 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:52:24.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:52:24.139 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:52:24.144 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:52:54.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:52:54.307 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:52:54.311 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:53:24.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:53:24.453 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:53:24.456 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:53:54.587 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:53:54.591 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:53:54.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:54:24.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:54:24.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:54:24.717 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:54:54.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:54:54.861 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:54:54.864 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:55:24.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:55:24.992 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:55:24.995 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:55:55.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:55:55.054 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:55:55.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:56:25.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:56:25.194 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:56:25.197 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:56:55.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:56:55.332 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:56:55.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:57:25.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:57:25.455 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:57:25.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:57:55.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:57:55.612 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:57:55.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:58:25.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:58:25.708 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:58:25.711 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:58:55.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:58:55.847 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:58:55.850 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:59:25.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:59:25.943 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:59:25.946 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:59:56.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:59:56.089 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T20:59:56.093 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:00:26.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:00:26.246 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:00:26.249 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:00:56.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:00:56.401 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:00:56.404 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:01:26.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:01:26.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:01:26.496 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:01:56.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:01:56.639 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:01:56.643 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:02:26.741 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:02:26.745 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:02:26.748 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:02:56.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:02:56.916 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:02:56.919 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:03:27.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:03:27.041 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:03:27.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:03:57.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:03:57.202 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:03:57.205 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:04:27.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:04:27.351 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:04:27.354 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:04:57.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:04:57.498 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:04:57.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:05:27.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:05:27.627 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:05:27.630 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:05:57.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:05:57.764 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:05:57.768 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:06:27.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:06:27.855 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:06:27.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:06:58.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:06:58.012 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:06:58.016 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:07:28.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:07:28.107 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:07:28.109 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:07:58.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:07:58.248 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:07:58.251 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:08:28.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:08:28.371 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:08:28.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:08:58.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:08:58.509 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:08:58.512 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:09:28.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:09:28.614 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:09:28.618 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:09:58.749 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:09:58.753 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:09:58.756 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:10:28.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:10:28.834 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:10:28.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:10:58.953 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:10:58.957 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:10:58.959 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:11:29.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:11:29.114 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:11:29.119 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:11:59.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:11:59.260 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:11:59.262 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:12:29.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:12:29.381 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:12:29.384 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:12:59.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:12:59.528 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:12:59.531 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:13:29.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:13:29.638 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:13:29.641 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:13:59.752 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:13:59.758 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:13:59.761 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:14:29.908 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:14:29.913 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:14:29.918 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:15:00.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:15:00.025 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:15:00.028 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:15:30.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:15:30.158 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:15:30.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:16:00.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:16:00.306 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:16:00.310 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:16:30.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:16:30.443 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:16:30.447 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:17:00.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:17:00.574 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:17:00.577 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:17:30.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:17:30.688 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:17:30.691 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:18:00.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:18:00.829 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:18:00.833 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:18:30.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:18:30.992 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:18:31.004 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:19:01.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:19:01.085 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:19:01.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:19:31.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:19:31.206 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:19:31.209 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:20:01.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:20:01.357 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:20:01.359 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:20:31.459 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:20:31.463 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:20:31.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:21:01.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:21:01.610 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:21:01.613 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:21:31.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:21:31.741 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:21:31.744 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:22:01.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:22:01.889 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:22:01.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:22:32.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:22:32.015 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:22:32.018 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:23:02.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:23:02.172 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:23:02.177 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:23:32.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:23:32.308 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:23:32.311 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:24:02.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:24:02.445 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:24:02.448 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:24:32.558 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:24:32.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:24:32.565 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:25:02.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:25:02.725 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:25:02.728 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:25:32.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:25:32.871 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:25:32.874 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:26:02.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:26:02.979 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:26:02.982 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:26:33.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:26:33.132 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:26:33.135 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:27:03.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:27:03.196 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:27:03.200 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:27:33.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:27:33.352 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:27:33.355 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:28:03.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:28:03.425 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:28:03.428 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:28:33.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:28:33.572 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:28:33.575 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:29:03.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:29:03.702 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:29:03.705 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:29:33.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:29:33.759 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:29:33.762 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:30:03.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:30:03.823 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:30:03.827 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:30:33.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:30:33.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:30:33.890 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:31:04.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:31:04.007 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:31:04.010 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:31:34.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:31:34.139 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:31:34.142 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:32:04.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:32:04.302 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:32:04.305 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:32:34.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:32:34.409 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:32:34.412 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:33:04.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:33:04.557 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:33:04.560 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:33:34.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:33:34.706 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:33:34.708 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:34:04.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:34:04.819 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:34:04.823 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:34:34.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:34:34.973 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:34:34.977 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:35:05.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:35:05.071 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:35:05.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:35:35.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:35:35.202 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:35:35.205 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:36:05.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:36:05.341 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:36:05.344 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:36:35.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:36:35.488 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:36:35.491 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:37:05.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:37:05.692 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:37:05.695 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:37:35.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:37:35.868 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:37:35.872 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:38:06.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:38:06.033 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:38:06.037 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:38:36.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:38:36.119 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:38:36.123 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:39:06.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:39:06.256 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:39:06.260 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:39:36.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:39:36.399 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:39:36.402 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:40:06.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:40:06.494 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:40:06.499 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:40:36.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:40:36.701 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:40:36.704 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:41:06.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:41:06.840 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:41:06.843 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:41:36.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:41:36.968 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:41:36.971 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:42:07.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:42:07.109 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:42:07.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:42:37.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:42:37.238 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:42:37.241 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:43:07.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:43:07.397 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:43:07.401 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:43:37.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:43:37.520 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:43:37.523 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:44:07.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:44:07.676 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:44:07.680 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:44:37.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:44:37.825 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:44:37.829 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:45:07.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:45:07.937 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:45:07.940 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:45:38.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:45:38.085 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:45:38.091 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:46:08.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:46:08.219 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:46:08.221 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:46:38.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:46:38.362 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:46:38.366 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:47:08.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:47:08.488 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:47:08.491 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:47:38.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:47:38.611 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:47:38.614 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:48:08.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:48:08.761 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:48:08.764 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:48:38.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:48:38.891 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:48:38.894 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:49:08.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:49:08.974 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:49:08.978 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:49:39.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:49:39.112 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:49:39.115 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:50:09.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:50:09.252 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:50:09.256 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:50:39.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:50:39.390 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:50:39.393 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:51:09.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:51:09.515 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:51:09.518 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:51:39.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:51:39.662 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:51:39.665 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:52:09.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:52:09.797 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:52:09.800 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:52:39.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:52:39.989 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:52:39.993 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:53:10.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:53:10.103 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:53:10.106 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:53:40.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:53:40.250 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:53:40.254 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:54:10.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:54:10.306 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:54:10.309 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:54:40.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:54:40.461 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:54:40.464 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:55:10.588 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:55:10.593 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:55:10.596 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:55:40.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:55:40.755 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:55:40.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:56:10.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:56:10.911 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:56:10.916 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:56:41.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:56:41.051 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:56:41.059 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:57:11.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:57:11.181 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:57:11.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:57:41.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:57:41.304 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:57:41.308 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:58:11.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:58:11.384 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:58:11.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:58:41.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:58:41.539 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:58:41.542 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:59:11.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:59:11.628 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:59:11.631 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:59:41.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:59:41.776 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T21:59:41.779 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:00:11.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:00:11.923 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:00:11.926 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:00:42.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:00:42.062 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:00:42.065 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:01:12.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:01:12.191 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:01:12.195 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:01:42.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:01:42.321 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:01:42.324 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:02:12.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:02:12.459 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:02:12.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:02:42.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:02:42.615 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:02:42.618 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:03:12.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:03:12.937 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:03:12.940 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:03:43.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:03:43.012 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:03:43.015 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:04:13.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:04:13.133 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:04:13.137 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:04:43.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:04:43.262 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:04:43.265 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:05:13.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:05:13.367 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:05:13.370 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:05:43.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:05:43.505 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:05:43.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:06:13.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:06:13.563 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:06:13.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:06:43.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:06:43.843 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:06:43.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:07:13.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:07:13.972 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:07:13.975 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:07:44.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:07:44.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:07:44.316 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:08:14.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:08:14.387 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:08:14.390 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:08:44.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:08:44.549 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:08:44.552 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:09:14.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:09:14.615 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:09:14.618 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:09:44.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:09:44.742 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:09:44.745 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:10:14.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:10:14.881 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:10:14.885 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:10:44.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:10:44.961 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:10:44.964 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:11:15.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:11:15.092 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:11:15.095 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:11:45.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:11:45.205 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:11:45.208 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:12:15.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:12:15.274 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:12:15.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:12:45.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:12:45.341 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:12:45.344 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:13:15.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:13:15.487 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:13:15.490 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:13:45.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:13:45.560 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:13:45.563 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:14:15.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:14:15.681 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:14:15.684 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:14:45.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:14:45.847 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:14:45.850 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:15:15.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:15:15.994 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:15:15.997 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:15:46.110 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:15:46.114 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:15:46.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:16:16.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:16:16.228 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:16:16.231 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:16:46.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:16:46.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:16:46.374 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:17:16.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:17:16.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:17:16.521 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-17T22:17:17.254 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-09-17T22:17:17.257 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2022-09-17T22:17:17.258 DEBUG:teuthology.task.console_log:Killing console logger for smithi093 2022-09-17T22:17:17.259 DEBUG:teuthology.task.console_log:Killing console logger for smithi159 2022-09-17T22:17:17.260 DEBUG:teuthology.exit:Finished running handlers